https://github.com/shmokmt/luigi-sample
Luigi sample project.
https://github.com/shmokmt/luigi-sample
luigi pipeline python3
Last synced: 7 months ago
JSON representation
Luigi sample project.
- Host: GitHub
- URL: https://github.com/shmokmt/luigi-sample
- Owner: shmokmt
- Archived: true
- Created: 2020-04-08T06:36:46.000Z (over 5 years ago)
- Default Branch: master
- Last Pushed: 2020-04-09T05:15:43.000Z (over 5 years ago)
- Last Synced: 2025-03-24T00:13:38.322Z (7 months ago)
- Topics: luigi, pipeline, python3
- Language: Python
- Homepage:
- Size: 10.7 KB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
## Luigi sample
### Usage
local-scheduler
```bash
$ python tasks/sample.py TaskA --local-scheduler
```
workers
```bash
$ python tasks/wrapper-sample.py --workers 3
```
## Refs
- [Luigi Official readthedocs](https://luigi.readthedocs.io/en/stable/index.html)
- [Luigiでデータ処理をきれいに書こう | RCO Ad-Tech Lab Blog](https://www.rco.recruit.co.jp/career/engineer/blog/akiba-python-luigi-01/)
- [機械学習で便利なluigiフレームワークの使い方 | M3 Tech Blog](https://www.m3tech.blog/entry/2018/10/17/105115)
- [luigiのtargetを自分で書くための解説 | M3 Tech Blog](https://www.m3tech.blog/entry/2018/11/12/110000)
- [hakobera/luigi-bigquery-exercise](https://github.com/hakobera/luigi-bigquery-exercise/blob/master/doc/luigi-basics.md)
- [Python: Luigiのパラメータ爆発問題について | CUBE SUGAR CONTAINER](https://blog.amedama.jp/entry/luigi-parameter-explosion)
- [Python: Luigiのイベントハンドラを試してみる | CUBE SUGAR CONTAINER](https://blog.amedama.jp/entry/luigi-event-handler)
- [Python: データパイプライン構築用フレームワークLuigiを使ってみる](https://blog.amedama.jp/entry/2017/05/13/203907) recommendation
- [Luigi | いかたこのたこつぼ](https://ikatakos.com/pot/programming/python/packages/luigi)
- [Luigi逆引きリファレンス](https://qiita.com/hagino3000/items/b9a7761dad1f352ec723#gcp)