https://github.com/mattbit/shuttle
A simple task manager for my scientific simulations.
https://github.com/mattbit/shuttle
Last synced: 12 months ago
JSON representation
A simple task manager for my scientific simulations.
- Host: GitHub
- URL: https://github.com/mattbit/shuttle
- Owner: mattbit
- License: gpl-3.0
- Created: 2019-02-26T15:32:55.000Z (over 7 years ago)
- Default Branch: master
- Last Pushed: 2019-02-27T14:52:38.000Z (over 7 years ago)
- Last Synced: 2025-03-02T16:49:31.621Z (over 1 year ago)
- Language: Python
- Homepage:
- Size: 27.3 KB
- Stars: 0
- Watchers: 2
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: readme.md
- License: LICENSE
Awesome Lists containing this project
README
[](https://scrutinizer-ci.com/g/mattbit/shuttle/?branch=master)
[](https://travis-ci.org/mattbit/shuttle)
# Shuttle 🚀
A simple task runner. **Work in progress, highly unstable.**
```python
from shuttle import Workflow
w = Workflow({'local_dir': '/data/storage'})
@w.source
def my_dataset():
return ['a', 'lot', 'of', 'data']
@w.task
def my_task(manager, task):
print(f'Running task {task.id}')
data = manager.get_source('my_dataset')
parameter = task.config.get('my.config.parameter')
result = do_something_with(data, parameter)
output = task.bucket.new_file('my_output.csv')
with open(output, 'w') as out:
out.write(result)
```