https://github.com/fd0/rabin-cdc

Fast implementation of Content Defined Chunking (CDC) based on a rolling Rabin Checksum in C.
https://github.com/fd0/rabin-cdc

Last synced: about 1 year ago
JSON representation

Fast implementation of Content Defined Chunking (CDC) based on a rolling Rabin Checksum in C.

• Host: GitHub
• URL: https://github.com/fd0/rabin-cdc
• Owner: fd0
• License: bsd-2-clause
• Created: 2014-09-15T20:35:21.000Z (over 11 years ago)
• Default Branch: master
• Last Pushed: 2014-10-02T21:00:35.000Z (over 11 years ago)
• Last Synced: 2025-03-01T15:51:20.394Z (about 1 year ago)
• Language: C
• Size: 148 KB
• Stars: 52
• Watchers: 6
• Forks: 16
• Open Issues: 2
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

          
Package chunker implements Content Defined Chunking (CDC) based on a rolling

Rabin Checksum.

Background Literature:

An introduction to Rabin Fingerprints/Checksums can be found in the following articles:

Michael O. Rabin (1981): "Fingerprinting by Random Polynomials"

http://www.xmailserver.org/rabin.pdf

Ross N. Williams (1993): "A Painless Guide to CRC Error Detection Algorithms"

http://www.zlib.net/crc_v3.txt

Andrei Z. Broder (1993): "Some Applications of Rabin's Fingerprinting Method"

http://www.xmailserver.org/rabin_apps.pdf

Andrew Kadatch, Bob Jenkins (2007): "Everything we know about CRC but afraid to forget"

http://crcutil.googlecode.com/files/crc-doc.1.0.pdf