{"id":15041153,"url":"https://github.com/maxi-k/btrblocks","last_synced_at":"2025-04-09T15:08:04.196Z","repository":{"id":174908721,"uuid":"643989867","full_name":"maxi-k/btrblocks","owner":"maxi-k","description":"BtrBlocks: Efficient Columnar Compression for Data Lakes (SIGMOD 2023 Paper)","archived":false,"fork":false,"pushed_at":"2025-04-07T10:12:31.000Z","size":253,"stargazers_count":238,"open_issues_count":8,"forks_count":20,"subscribers_count":7,"default_branch":"master","last_synced_at":"2025-04-09T15:08:02.976Z","etag":null,"topics":["compression","data-lake","databases","research"],"latest_commit_sha":null,"homepage":"","language":"C++","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/maxi-k.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2023-05-22T15:15:22.000Z","updated_at":"2025-04-07T10:12:35.000Z","dependencies_parsed_at":"2024-02-01T18:07:54.157Z","dependency_job_id":"c349c0e2-cabd-468b-8f47-dc20a46f43e3","html_url":"https://github.com/maxi-k/btrblocks","commit_stats":{"total_commits":7,"total_committers":2,"mean_commits":3.5,"dds":0.2857142857142857,"last_synced_commit":"d1c1d26890d86b7f8914489c15e52ba454dd7e20"},"previous_names":["maxi-k/btrblocks"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/maxi-k%2Fbtrblocks","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/maxi-k%2Fbtrblocks/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/maxi-k%2Fbtrblocks/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/maxi-k%2Fbtrblocks/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/maxi-k","download_url":"https://codeload.github.com/maxi-k/btrblocks/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":248055284,"owners_count":21040157,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["compression","data-lake","databases","research"],"created_at":"2024-09-24T20:45:41.014Z","updated_at":"2025-04-09T15:08:04.177Z","avatar_url":"https://github.com/maxi-k.png","language":"C++","readme":"# BtrBlocks - Efficient Columnar Compression for Data Lakes\n\n[![Paper](https://img.shields.io/badge/paper-SIGMOD%202023-green)](https://bit.ly/btrblocks)\n[![Build](https://github.com/maxi-k/btrblocks/actions/workflows/test.yml/badge.svg?event=push)](https://github.com/maxi-k/btrblocks/actions/workflows/test.yml)\n\n- [Paper](https://bit.ly/btrblocks) (two-column version)\n- [Video](https://dl.acm.org/doi/10.1145/3589263) (SIGMOD 2023 presentation)\n\n## Usage\n\nAfter [building](#building) the library, follow one of the [examples](./tools/examples) to get started.\n\n## Components\n\n- `btrblocks/`: the compression library, schemes, utilities, ...\n- `btrfiles/`: helper library for binary files and yaml schema information\n- `tools/`: various conversion, measurement and benchmarking tools\n- `test/`: rudimentary tests for the library\n\n![Dependency Graph](./doc/dependencies.svg)\n\n## Building\n\nWe currently require an x86 platform.\nThis library was built and tested on linux only.\n\n``` sh\nmkdir build \ncd build\ncmake ..\n```\n\nThen, depending on your usecase, build only the library or any of the tools:\n- build everything: `make`\n- install static library and headers on your system: `sudo make install`\n- build the compression library only: `make btrblocks`\n- build the tests `make tester`\n- build the in-memory decompression speed benchmark: `make decompression_speed`\n- ...\n\nFor a list of all valid targets, run `make help`.\n\nLibrary was built and tested on Linux (x86, ARM) and MacOS (ARM).\n\n## Contributors\n\nAdnan Alhomssi\nDavid Sauerwein\nMaximilian Kuschewski\n\n## License\n\nMIT - See [License File](LICENSE)\n","funding_links":[],"categories":[],"sub_categories":[],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fmaxi-k%2Fbtrblocks","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fmaxi-k%2Fbtrblocks","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fmaxi-k%2Fbtrblocks/lists"}