Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/aneeshdurg/buffcat
A heavy-duty file concatenation tool. It's `cat` on steroids.
https://github.com/aneeshdurg/buffcat
Last synced: 28 days ago
JSON representation
A heavy-duty file concatenation tool. It's `cat` on steroids.
- Host: GitHub
- URL: https://github.com/aneeshdurg/buffcat
- Owner: aneeshdurg
- License: mit
- Created: 2024-12-11T03:44:33.000Z (about 1 month ago)
- Default Branch: main
- Last Pushed: 2024-12-11T03:48:02.000Z (about 1 month ago)
- Last Synced: 2024-12-11T04:27:56.411Z (about 1 month ago)
- Language: Rust
- Size: 0 Bytes
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# BuffCat
A heavy-duty file concatenation tool. It's `cat` on steroids.
BuffCat aims to be a fast tool for building files as concatenations of other files.
BuffCat overcomes limitations of `cat`, by providing faster output generation, features to specify
that files should be written multiple times, and with no limits on the number of input files.The following example shows the output of appending the same file 1000000 times. In 82s, 116GB is
written to disk.```console
aneesh@orion:~/buffcat$ cargo r -- -r 1000000 lineitem_small.tbl -o lineitem_output.tbl
Finished `dev` profile [unoptimized + debuginfo] target(s) in 0.02s
Running `target/debug/buffcat -r 1000000 lineitem_small.tbl -o lineitem_output.tbl`
100%|██████████████████████████████████████████████████████| 123848000000/123848000000 [01:22<00:00, 1643609143.85it/s]
```