https://github.com/fd0/rabin-cdc

Fast implementation of Content Defined Chunking (CDC) based on a rolling Rabin Checksum in C.
https://github.com/fd0/rabin-cdc

Last synced: 2 months ago
JSON representation

Fast implementation of Content Defined Chunking (CDC) based on a rolling Rabin Checksum in C.

• Host: GitHub
• URL: https://github.com/fd0/rabin-cdc
• Owner: fd0
• License: bsd-2-clause
• Created: 2014-09-15T20:35:21.000Z (over 10 years ago)
• Default Branch: master
• Last Pushed: 2014-10-02T21:00:35.000Z (over 10 years ago)
• Last Synced: 2024-10-14T21:05:35.808Z (3 months ago)
• Language: C
• Size: 148 KB
• Stars: 47
• Watchers: 6
• Forks: 16
• Open Issues: 2
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
Package chunker implements Content Defined Chunking (CDC) based on a rolling

Rabin Checksum.

Background Literature:

An introduction to Rabin Fingerprints/Checksums can be found in the following articles:

Michael O. Rabin (1981): "Fingerprinting by Random Polynomials"

http://www.xmailserver.org/rabin.pdf

Ross N. Williams (1993): "A Painless Guide to CRC Error Detection Algorithms"

http://www.zlib.net/crc_v3.txt

Andrei Z. Broder (1993): "Some Applications of Rabin's Fingerprinting Method"

http://www.xmailserver.org/rabin_apps.pdf

Andrew Kadatch, Bob Jenkins (2007): "Everything we know about CRC but afraid to forget"

http://crcutil.googlecode.com/files/crc-doc.1.0.pdf