https://github.com/johnuopini/csvexec
Split a CSV and execute parallel, template based, shell script jobs
https://github.com/johnuopini/csvexec
csv shell
Last synced: 2 months ago
JSON representation
Split a CSV and execute parallel, template based, shell script jobs
- Host: GitHub
- URL: https://github.com/johnuopini/csvexec
- Owner: johnuopini
- License: mit
- Created: 2022-05-03T13:50:16.000Z (almost 4 years ago)
- Default Branch: master
- Last Pushed: 2022-06-06T12:03:20.000Z (almost 4 years ago)
- Last Synced: 2024-06-20T19:20:00.322Z (almost 2 years ago)
- Topics: csv, shell
- Language: Go
- Homepage:
- Size: 24.4 KB
- Stars: 1
- Watchers: 2
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
## Csv Exec
This tool will parse a CSV file then, for every single line, it will create a shell script based on django template
syntax and execute the task in parallel. Failures will be logged.
### Example
You can use the data in the example folder to test it out:
```bash
$ csvexec examples/echo/echo.csv examples/echo/echo.sh.j2
Starting runner 05/03 04:00:38PM '22 +0200:
- Jobs: 8, total 1034 lines, stop at 1034
- Csv: examples/echo/echo.csv
- Template: examples/echo/echo.sh.j2
- Workdir: /tmp/csvexec
- Eta: 1m3s [+===>-------------------------] 7.4% [failed:10] [avg:66ms]
```