Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/claymcleod/celcius
Wrapper for UNIX utilities and data pipelining using those utilities (Proof of concept)
https://github.com/claymcleod/celcius
Last synced: about 2 months ago
JSON representation
Wrapper for UNIX utilities and data pipelining using those utilities (Proof of concept)
- Host: GitHub
- URL: https://github.com/claymcleod/celcius
- Owner: claymcleod
- License: mit
- Created: 2016-01-15T07:15:23.000Z (about 9 years ago)
- Default Branch: master
- Last Pushed: 2016-01-17T21:29:50.000Z (about 9 years ago)
- Last Synced: 2024-11-04T00:02:21.583Z (3 months ago)
- Language: Python
- Homepage:
- Size: 70.3 KB
- Stars: 4
- Watchers: 2
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE.md
Awesome Lists containing this project
README
This repository contains a proof of concept for data pipelining using only UNIX microservices. A full writeup for the motivation and discussion of this technique can be found [here](https://medium.com/@claymcleod_/data-pipelining-using-unix-microservices-9551b1f4ae50).
## Current capabililties
Currently, celcius contains wrappers for many UNIX command line tools as well as mechanisms for provisioning/removing those workflows as cronjobs. Feel free to use it as a command line interface for scheduling celcius jobs OR in your own Python scripts to wrap UNIX commands.
## Command line options available
Check the 'scripts' folder for a full list of commands available:
```
# Configure celcius by evaluating which tools are available
celcius-init
# Schedule celcius jobs using cron
celcius-schedule
# Remove celcius jobs from cron
celcius-unschedule
# Check the status of celcius jobs stored in cron
celcius-status
```
## Example
```
# Clone the repo
git clone https://github.com/claymcleod/celcius.git
# Install the library, init-celcius
cd celcius/ && python setup.py install && celcius-init
# Give the examples permissions to run
chmod +x ./examples/iris.sh
# Run the iris example
./examples/iris.sh
```