Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/wittline/wbz
A parallel implementation of the bzip2 data compressor in python, this data compression pipeline is using algorithms like Burrows–Wheeler transform (BWT) and Move to front (MTF) to improve the Huffman compression. For now, this tool only will be focused on compressing .csv files, and other files on tabular format.
https://github.com/wittline/wbz
big-data bigdata burrows-wheeler-transform csv csv-files data-compression data-engineering huffman-coding huffman-compression-algorithm move-to-front tabular-data
Last synced: 3 months ago
JSON representation
A parallel implementation of the bzip2 data compressor in python, this data compression pipeline is using algorithms like Burrows–Wheeler transform (BWT) and Move to front (MTF) to improve the Huffman compression. For now, this tool only will be focused on compressing .csv files, and other files on tabular format.
- Host: GitHub
- URL: https://github.com/wittline/wbz
- Owner: Wittline
- License: apache-2.0
- Created: 2022-01-07T03:15:49.000Z (about 3 years ago)
- Default Branch: main
- Last Pushed: 2022-06-29T15:09:12.000Z (over 2 years ago)
- Last Synced: 2024-05-02T04:05:16.874Z (8 months ago)
- Topics: big-data, bigdata, burrows-wheeler-transform, csv, csv-files, data-compression, data-engineering, huffman-coding, huffman-compression-algorithm, move-to-front, tabular-data
- Language: Python
- Homepage: https://wittline.github.io/wbz/
- Size: 578 KB
- Stars: 13
- Watchers: 2
- Forks: 3
- Open Issues: 0