Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/pavloo/dag-traverse-celery-example
https://github.com/pavloo/dag-traverse-celery-example
Last synced: about 2 months ago
JSON representation
- Host: GitHub
- URL: https://github.com/pavloo/dag-traverse-celery-example
- Owner: pavloo
- Created: 2018-03-07T10:34:32.000Z (almost 7 years ago)
- Default Branch: master
- Last Pushed: 2018-03-08T13:07:44.000Z (almost 7 years ago)
- Last Synced: 2024-10-15T20:15:01.650Z (about 2 months ago)
- Language: Python
- Homepage: https://medium.com/@pavloosadchyi/parallel-running-dag-of-tasks-in-pythons-celery-4ea73c88c915
- Size: 6.84 KB
- Stars: 28
- Watchers: 0
- Forks: 7
- Open Issues: 1
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
- awesome - dag-traverse-celery-example - (Python)
README
### About
This project is an example project that complements a blog post about how to implement a job scheduler for traversing DAG of tasks in Python's [Celery](http://celery.readthedocs.io)
### How to run
#### Dependencies
1. `MySQL 5.6`+
2. `RabbitMQ`
3. `Python 3`
#### Steps
1. `git clone [email protected]:pavloo/dag-traverse-celery-example.git`
2. `cd dag-traverse-celery-example`
3. `pip install -r requirements.txt`
4. `celery worker -A dag.task -Q queue-1`
5. `python -m dag.run`