{"id":15293281,"url":"https://github.com/a-poor/brickdb","last_synced_at":"2026-02-27T14:11:07.686Z","repository":{"id":174843481,"uuid":"652874148","full_name":"a-poor/brickdb","owner":"a-poor","description":"A small basic proof-of-concept database written in Rust. I wouldn't recommend using this in production.","archived":false,"fork":false,"pushed_at":"2024-12-01T02:06:34.000Z","size":125,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":2,"default_branch":"main","last_synced_at":"2025-05-02T05:04:49.925Z","etag":null,"topics":["database","rust","storage"],"latest_commit_sha":null,"homepage":"https://crates.io/crates/brickdb","language":"Rust","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/a-poor.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2023-06-13T01:12:22.000Z","updated_at":"2024-12-01T02:06:38.000Z","dependencies_parsed_at":null,"dependency_job_id":"7d13f2e2-dc7f-4ec9-9353-737cb5fefbaf","html_url":"https://github.com/a-poor/brickdb","commit_stats":{"total_commits":57,"total_committers":1,"mean_commits":57.0,"dds":0.0,"last_synced_commit":"ecd9cc95b1a0e9399c2e049ed1b660d4f2d03d82"},"previous_names":["a-poor/brickdb"],"tags_count":1,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/a-poor%2Fbrickdb","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/a-poor%2Fbrickdb/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/a-poor%2Fbrickdb/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/a-poor%2Fbrickdb/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/a-poor","download_url":"https://codeload.github.com/a-poor/brickdb/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":252280881,"owners_count":21723054,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["database","rust","storage"],"created_at":"2024-09-30T16:45:21.091Z","updated_at":"2025-10-27T20:07:13.994Z","avatar_url":"https://github.com/a-poor.png","language":"Rust","funding_links":[],"categories":[],"sub_categories":[],"readme":"# BrickDB\n\n[![Rust Test](https://github.com/a-poor/brickdb/actions/workflows/rust-test.yml/badge.svg)](https://github.com/a-poor/brickdb/actions/workflows/rust-test.yml)\n[![Crates.io](https://img.shields.io/crates/v/brickdb)](https://crates.io/crates/brickdb)\n[![Crates.io](https://img.shields.io/crates/l/brickdb)](https://crates.io/crates/brickdb)\n[![docs.rs](https://img.shields.io/docsrs/brickdb)](https://docs.rs/brickdb)\n\n\n_created by Austin Poor_\n\nA small basic proof-of-concept database written in Rust. I wouldn't recommend using this in production.\n\n\n## Ideas for the Future\n\n- Sharding\n- Multi-node clusters (via Raft?)\n- Schema validation (e.g )\n\n\n## Notes\n\n- [x] Update the `storage::level::Level::new` implementation to format the path using the `path` argument as a _parent directory path_\n- [x] The LSMTree should be able to move data between levels (eg memtable -\u003e level-1-sstable) without downtime (if possible). Can it craete an sstable from the memtable, write the memtable to disk, and then clear the memtable? Should there be a _frozen_ memtable that can be read from but not written to, while the on-disk operations are working?\n- [x] Like the above, should also (maybe) work with SSTables? Or do they not need to, since they're read-only?\n    - Maybe they don't need to but need to be able to mark which table-ids are being compacted. So compaction can start on level 1 (say) and while it's happening, they can still be read from, until the new level-2 table is ready, at which point the level-1 tables can be removed. But since a new level one table might have been added (probably _shouldn't_ have been but _could_ have been), the compaction process should remember which tables it's including and not just say _all tables in level 1_.\n- [x] Compress data written to disk with snappy compression? (try `snap`)\n- [ ] There was an error with the snappy compression that I didn't *really* look into deeply. Go back and figure it out!\n- [ ] Update `todo!()`s in tests (and the commented-out tests)\n- [ ] Add the ability to encrypt data on disk (`aes` with [ring](https://docs.rs/ring/latest/ring)?)\n- [ ] The `bloom` create hasn't had any updates in the past 7 years. Consider changing to a different implementation or writing it myself.\n- [ ] Add metadata for the `storage::lsm::LSMTree` so it can be read back in.\n- [ ] Create a separate reader/writer implementation for reading/writing data. It can simplify async writing of `bson` data, compression (share encoders/decoders?), and encryption.\n- [ ] Implement the `WAL`\n\n\n## Database Disk Structure\n\n```\n...\n```\n\n## To-Do\n- [ ] Define on-disk structure for LSM\n- [ ] Implement WAL\n- [ ] Add compression when reading/writing from/to disk\n- [ ] Add encryption when reading/writing from/to disk\n- [ ] Add indexes\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fa-poor%2Fbrickdb","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fa-poor%2Fbrickdb","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fa-poor%2Fbrickdb/lists"}