https://github.com/oleiade/butcher
Slice fat files into shinny slim ones in just a command
https://github.com/oleiade/butcher
Last synced: 10 months ago
JSON representation
Slice fat files into shinny slim ones in just a command
- Host: GitHub
- URL: https://github.com/oleiade/butcher
- Owner: oleiade
- Created: 2013-01-04T18:33:55.000Z (about 13 years ago)
- Default Branch: master
- Last Pushed: 2013-01-14T07:46:49.000Z (about 13 years ago)
- Last Synced: 2025-02-26T13:50:43.689Z (11 months ago)
- Language: Go
- Homepage:
- Size: 133 KB
- Stars: 2
- Watchers: 3
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
Butcher
=======
Slice fat files into shinny slim ones in just a command
```
butcher -input bigfatfile -output dir -sample linecountbysubfile
```
It's goal is to help splitting very large files into smaller ones based on line count, or size, or the number of
output files you'd want to see generated. Supporting input and ouput compression (tar, gzip, bz2, zip, lz4), and
delivering a live progress estimation.
Butcher is written in Go, and intend to be efficient, portable, and more importantly : extandable.
In the pipe (still under development):
*quite everything at the moment*
* Compression support
* Split based on size
* Split by output files count
* Tests
* Clean packaging and extendability