https://github.com/ph4r05/lz4-checkpoints

LZ4 encryptor/decryptor with checkpoint support for a random access. Can resume decompress operation of TB-large files after a crash.
https://github.com/ph4r05/lz4-checkpoints

checkpoints lz4 python random-access

Last synced: 3 months ago
JSON representation

LZ4 encryptor/decryptor with checkpoint support for a random access. Can resume decompress operation of TB-large files after a crash.

• Host: GitHub
• URL: https://github.com/ph4r05/lz4-checkpoints
• Owner: ph4r05
• License: mit
• Created: 2018-01-13T19:50:43.000Z (over 7 years ago)
• Default Branch: master
• Last Pushed: 2018-01-13T19:54:00.000Z (over 7 years ago)
• Last Synced: 2025-02-25T00:39:23.063Z (3 months ago)
• Topics: checkpoints, lz4, python, random-access
• Language: Python
• Homepage: https://ph4r05.deadcode.me/blog/2017/10/04/lz4-stream-processing.html
• Size: 7.81 KB
• Stars: 0
• Watchers: 3
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# LZ4 checkpoints

Builds LZ4 mapping file for random access

With the mapping file you can resume the LZ4 decompressor reading state at the position

of the checkpoint.

In this way you can get LZ4 random access for a very large files.

More in the blog post

[https://ph4r05.deadcode.me/blog/2017/10/04/lz4-stream-processing.html](https://ph4r05.deadcode.me/blog/2017/10/04/lz4-stream-processing.html)