An open API service indexing awesome lists of open source software.

https://github.com/io-developer/py-blockdiff

Fast fixed-size snapshot diff and incremental backup
https://github.com/io-developer/py-blockdiff

backup efficient fast incremental snapshot

Last synced: about 1 year ago
JSON representation

Fast fixed-size snapshot diff and incremental backup

Awesome Lists containing this project

README

          

# Blockdiff
Fast fixed-size snapshot diff and writer / incremental backup. One pass for input read and on-fly diff + output

## Install
Required python 3.6 or higher

## Usage
Suppose exists two snaphots A and B with the same size. You have to determine which blocks are changed from A to B.

Lets output first level to .tar with 128 bytes per block resolution. Block-map we will save to 'files/level1.blockmap':
```bash
blockdiff-cli -f files/1.txt -m tar -d files/level1.tar -bs 128 --output-map files/level1.blockmap --verbose 1
>
> +++++++++++++++++++++
>
> Total stats: 100.0% 0.0 MB/s
```

Now we can compare snapshot B with A and write to 'files/level2.tar' only changed blocks. Updated block-map will be saved to 'files/.blockmap'
```bash
blockdiff-cli -f files/2.txt -m tar -d files/level2.tar -bs 128 --input-map files/level1.blockmap --output-map files/.blockmap --verbose 1
>
> .........+.........+.
>
> Total stats: 100.0% 0.0 MB/s
```

And so on with short syntax in quiet mode:
```bash
blockdiff-cli -f files/3.txt -m tar -d files/level3.tar -bs 128 -bm files/.blockmap
>
> Total stats: 100.0% 0.0 MB/s
```