https://github.com/matrixorigin/git4data-tutorial
Runnable companion code & SQL for the MatrixOne Git4Data tutorial series — Git-style version control for data at scale.
https://github.com/matrixorigin/git4data-tutorial
Last synced: 11 days ago
JSON representation
Runnable companion code & SQL for the MatrixOne Git4Data tutorial series — Git-style version control for data at scale.
- Host: GitHub
- URL: https://github.com/matrixorigin/git4data-tutorial
- Owner: matrixorigin
- License: apache-2.0
- Created: 2026-06-04T15:28:49.000Z (16 days ago)
- Default Branch: main
- Last Pushed: 2026-06-05T08:54:30.000Z (15 days ago)
- Last Synced: 2026-06-05T09:12:50.323Z (15 days ago)
- Size: 13.7 KB
- Stars: 0
- Watchers: 0
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# MatrixOne Git4Data Tutorial
Runnable companion code for the **MatrixOne Git4Data Deep Dive** article series —
Git-style version control for data at scale (`commit`, `branch`, `diff`, `merge`,
`cherry-pick`, time travel), built into [MatrixOne](https://github.com/matrixorigin/matrixone).
> What is Git4Data? If you treat a database as a Git repository and a table as a
> file in it, MatrixOne lets you run everyday Git operations — snapshot, clone,
> branch, diff, merge, cherry-pick, restore — over terabytes of data, almost
> instantly. It's the same workflow software engineers use on code, now on data.
## The series
| Part | Topic | Code here |
|------|-------|-----------|
| 1 | The Git moment for data at scale (concept) | — |
| 2 | **Hands on: from zero, through every Git primitive** | [`02-hands-on/`](02-hands-on/) |
| … | more coming (implementation principles, ML/agent scenarios) | |
Each later tutorial will add its own folder here.
## Quick start (5 minutes)
```bash
# 1. Run a local MatrixOne (open source, MySQL-compatible)
docker run -d -p 6001:6001 --name matrixone matrixorigin/matrixone:4.0.0-rc1
# 2. Run the Part 2 walkthrough — every Git primitive on 1,000,000 rows
mysql -h 127.0.0.1 -P 6001 -u root -p111 < 02-hands-on/git4data_primitives.sql
```
Default credentials: user `root`, password `111`, port `6001`.
## What Part 2 covers
[`02-hands-on/git4data_primitives.sql`](02-hands-on/git4data_primitives.sql) is a
single, copy-paste-runnable script (English comments) that walks through:
- **commit / tag / reset** — `CREATE SNAPSHOT`, time-travel `SELECT … {snapshot=…}`, `RESTORE`
- **clone** — zero-copy `CREATE TABLE … CLONE`
- **branch** — lineage-tracked `DATA BRANCH CREATE`
- **diff** — row-level `DATA BRANCH DIFF … OUTPUT SUMMARY / COUNT / LIMIT / FILE`
- **merge** — three-way `DATA BRANCH MERGE … WHEN CONFLICT FAIL | SKIP | ACCEPT`
- **cherry-pick** — `DATA BRANCH PICK … KEYS(…)`
- **point-in-time recovery** — `CREATE PITR` + `RESTORE … FROM PITR "…"`
- **granularity** — the same semantics at **table / database / account / cluster** levels
- **scale** — measured numbers showing snapshot/clone/branch cost is independent of table size
It loads a million rows with a single `generate_series` statement (no external
files needed) and cleans up after itself.
## Measured: cost is independent of data size
Same table, same operations, on a single-node Docker MatrixOne (diff/merge each
touch only 1,000 rows):
Steady-state, median of several runs (MatrixOne 4.0.0-rc1):
| table size | load | `CREATE SNAPSHOT` | `CLONE` | `DATA BRANCH CREATE` | `DIFF` (1000) | `MERGE` (1000) |
|---|---|---|---|---|---|---|
| 1,000,000 | 0.5 s | 6 ms | 6 ms | 7 ms | 13 ms | 64 ms |
| 10,000,000 | 5.3 s | 8 ms | 8 ms | 7 ms | 21 ms | 178 ms |
| 100,000,000 | 41 s | 5 ms | 25 ms | 19 ms | 23 ms | 189 ms |
Snapshot is dead constant (it just names a metadata directory). Clone/branch copy
the metadata directory, not the data — 100× the data, clone rises only 6 ms → 25 ms.
Diff/merge scale with *how many rows changed*, not table size. (The first snapshot
of a freshly loaded table is ~10–12 ms — a one-time flush of in-memory data — then
drops to the steady-state numbers above.)
## Links
- MatrixOne: https://github.com/matrixorigin/matrixone
- Docs: https://docs.matrixorigin.cn/
## License
Apache 2.0