https://github.com/rupurt/tif

Lightning fast tabular diffs, patches and merges for larger than memory datasets
https://github.com/rupurt/tif

csv diff relational-model table-diff zig

Last synced: about 4 hours ago
JSON representation

Lightning fast tabular diffs, patches and merges for larger than memory datasets

• Host: GitHub
• URL: https://github.com/rupurt/tif
• Owner: rupurt
• License: mit
• Created: 2023-08-29T01:08:15.000Z (about 1 year ago)
• Default Branch: main
• Last Pushed: 2023-09-14T08:19:46.000Z (about 1 year ago)
• Last Synced: 2023-09-14T12:37:48.468Z (about 1 year ago)
• Topics: csv, diff, relational-model, table-diff, zig
• Language: Zig
• Homepage:
• Size: 16.6 KB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# Tif

Lightning fast tabular [diffs](./docs/DIFF.md), [patches](./docs/PATCH.md) and

[merges](./docs/MERGE.md) for larger than memory datasets.

## Usage

```shell

tif test/fixtures/people.csv test/fixtures/people_reverse.csv

```

```shell

tif

[-h] [-r ] [-c ] [-m ]  

```

```shell

tif -h

    -h, --help

            Display this help and exit.

    -r, --readbuffer 

            Number of bytes to use as a buffer. Default: 65536

    -c, --colbuffer 

            Number of bytes to use as a column buffer. Default: 4096

    -m, --maxcolumns 

            Maximum number of columns in a record. Default: 512

    

            The base path

    

            The path to compare

```

## How

`tif` produces differences over datasets by generating a [literal](./docs/ARCHITECTURE.md#literal-layer),

[logical](./docs/ARCHITECTURE.md#logical-layer) and [physical](./docs/ARCHITECTURE.md#physical-layer) layer

for the given inputs.

Diffs are produced according to the [Daff tabular diff specification](http://paulfitz.github.io/daff-doc/spec.html).

## Development

This project assumes you have already [installed nix](https://determinate.systems/posts/determinate-nix-installer)

1. Start a Nix devshell

```shell

nix develop -c $SHELL

```

2. Build and run with the zig toolchain

```shell

zig build run -- test/fixtures/people.csv test/fixtures/people_reverse.csv

```

## License

`tif` is released under the [MIT license](./LICENSE)