{"id":13797522,"url":"https://github.com/yildizdb/yildiz","last_synced_at":"2025-05-13T04:31:50.519Z","repository":{"id":44843827,"uuid":"106202793","full_name":"yildizdb/yildiz","owner":"yildizdb","description":":unicorn::star2: Graph Database layer on top of Google Bigtable","archived":false,"fork":false,"pushed_at":"2022-12-10T14:50:12.000Z","size":1297,"stargazers_count":26,"open_issues_count":13,"forks_count":3,"subscribers_count":4,"default_branch":"master","last_synced_at":"2025-04-19T19:23:46.047Z","etag":null,"topics":["big-data","bigtable","database","edges","event-relation","graph","graph-database","hyper-relational","nodejs","nodes","yildiz"],"latest_commit_sha":null,"homepage":"","language":"TypeScript","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/yildizdb.png","metadata":{"files":{"readme":"README.md","changelog":"CHANGELOG.md","contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2017-10-08T19:15:35.000Z","updated_at":"2023-02-27T17:21:37.000Z","dependencies_parsed_at":"2023-01-26T07:46:15.572Z","dependency_job_id":null,"html_url":"https://github.com/yildizdb/yildiz","commit_stats":null,"previous_names":["krystianity/krakn"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/yildizdb%2Fyildiz","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/yildizdb%2Fyildiz/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/yildizdb%2Fyildiz/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/yildizdb%2Fyildiz/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/yildizdb","download_url":"https://codeload.github.com/yildizdb/yildiz/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":253876749,"owners_count":21977629,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["big-data","bigtable","database","edges","event-relation","graph","graph-database","hyper-relational","nodejs","nodes","yildiz"],"created_at":"2024-08-04T00:00:22.638Z","updated_at":"2025-05-13T04:31:49.869Z","avatar_url":"https://github.com/yildizdb.png","language":"TypeScript","funding_links":[],"categories":["Tools"],"sub_categories":["Databases"],"readme":"\u003ch1 align=\"center\"\u003eYildiz Graph Database\u003c/h1\u003e\n\u003cp align=\"center\"\u003e\n  \u003cimg alt=\"yildiz\" src=\"docs/images/YildizDBLogo.png\" width=\"362\"\u003e\n\u003c/p\u003e\n\u003cp align=\"center\"\u003e\n  Thin graph database layer on top of Google Bigtable.\n\u003c/p\u003e\n\n[![Build Status][build-badge]][build] [![Version][version-badge]][package] [![MIT License][license-badge]][license] ![node][node-badge] [![Swagger][swagger-badge]][swagger-url]\n[![Mentioned in Awesome Bigtable](https://awesome.re/mentioned-badge-flat.svg)](https://github.com/zrosenbauer/awesome-bigtable)\n\n\n## Intro\n\nYildizDB acts as a highly scaleable HTTP layer in front of Google Bigtable. It helps you store billions of relations between nodes in edges and resolve them in milliseconds. A small access layer helps you manage multiple namespaces with ease. YildizDB scales to hundrets of Terabytes. YildizDB excells in $N:N$ non nested relationships.\n\n## Features\n\n* simple namespacing (table separation) with [prefixes](docs/access.md)\n* simple access management through [tokens](docs/access.md)\n* multi-tenancy through table prefixes (with [access management](docs/access.md))\n* high read and write performance\n* fast read access under heavy write load\n* able to handle billions of edges and nodes\n* scales beyond Terabytes\n* lightweight deployments (small Node.js footprint)\n* ttl feature for all resources\n* HTTP [Open API][swagger-url]\n* Kubernetes HELM [charts](https://github.com/yildizdb/charts)\n\n## Build for high throughput $N:N$\n\n* Highly async API based on `fastify`\n* Thin layer on top of Google's GRPC Bigtable API\n* Hashing and translating all string identifiers into **integer** representations via `murmurhash3` automatically\n\n## Fast random access to a node's edge data $1:N$\n\n* Multiple complex caching layers\n* Custom Bigtable cache table speed up by Google Memorystore (Redis)\n* All Memorystore hits also speed up by In-Memory store\n* Fetch job that keeps active nodes refreshed in cache\n\n## Available clients\n\n* [Node.js Client](https://github.com/yildizdb/yildiz-js)\n* **Any Http Client** can be used to access the HTTP-Interface\n\n## Usage\n\n* **You will need a Google Cloud Project with a running Bigtable cluster**\n* **Additionally YildizDB requires a Memorystore (or Redis) instance**\n* Configure `./config/bigtable.json` accordingly\n* Install and start: `npm install -g yildiz` and `yildizdb -p 3058 -l ./config/bigtable.json`\n* A word on configuration [can be found here](docs/configuration.md)\n* Use right [alongside your code](example/yildiz-sample.js)\n* Spawn server via [http interface](example/yildiz-http.js)\n\n## Deployment\n\n* YildizDB is designed to be deployed as simple platform service\n* it requires Node.js \u003e 9.x.x and Redis \u003e 3.x\n* It simply requires its npm module as well as a config file that describes\nthe connections to Bigtable and Memorystore (Redis)\n* It scales best with an HTTP load balancer in front of it e.g. NGINX\n* We run and scale it very successfully in Google's Kubernetes Engine\n* We also offer HELM [charts](https://github.com/yildizdb/charts)\n* Read some more about the config file [here](docs/configuration.md)\n\n## Metrics \u0026 Monitoring\n\n* Yildiz exposes Prometheus Metrics @ `/admin/metrics`\n* Read more about it [here](docs/metrics.md)\n\n## Developing YildizDB\n\n### Developing YildizDB with Google Bigtable backend\n\n* Configure `./config/bigtable.json` accordingly\n* Run tests via `yarn test`\n* Start via `yarn http`\n\n## Documentation\n\n* `yildiz` means :star: in turkish\n* [Best practice](docs/best-practice.md)\n* [Open API/Swagger JSON](docs/swagger.json)\n* [Access management](docs/access.md)\n* [Stats and metrics](docs/metrics.md)\n* [YildizDB Use-cases](docs/use-cases.md)\n* [Why develop another Graph Database?](docs/why.md)\n* [How does it work?](docs/how.md)\n* [Storing node relations even faster](docs/fast-relation-creation.md)\n* [The popular right node concept](docs/popular-right-node.md)\n* [\"Depth\" or \"Create\" edge creation](docs/edge-modes.md)\n* [Configuration \u0026 Deployments](docs/configuration.md)\n\n## Disclaimer\n\n* This project is not affiliated with Google\n* License is MIT [see](LICENSE)\n\n\u003c!-- badges --\u003e\n[build-badge]: https://quay.io/repository/yildizdb/yildiz/status \"Docker Repository on Quay\"\n[build]: https://quay.io/repository/yildizdb/yildiz\n[version-badge]: https://badge.fury.io/js/yildiz.svg\n[package]: https://www.npmjs.com/package/yildiz\n[license-badge]: https://img.shields.io/npm/l/yildiz.svg\n[license]: https://opensource.org/licenses/MIT\n[swagger-url]: https://petstore.swagger.io/?url=https://raw.githubusercontent.com/yildizdb/yildiz/master/docs/swagger.yml\n[node-badge]: https://img.shields.io/node/v/yildiz.svg\n[swagger-badge]: https://img.shields.io/badge/Swagger%20UI-OK-orange.svg\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fyildizdb%2Fyildiz","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fyildizdb%2Fyildiz","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fyildizdb%2Fyildiz/lists"}