{"id":25224111,"url":"https://github.com/hydradatabase/columnar","last_synced_at":"2025-05-14T02:04:23.110Z","repository":{"id":52566844,"uuid":"516821813","full_name":"hydradatabase/columnar","owner":"hydradatabase","description":"Postgres-native columnar storage extension","archived":false,"fork":false,"pushed_at":"2025-02-10T14:58:06.000Z","size":4734,"stargazers_count":2944,"open_issues_count":29,"forks_count":84,"subscribers_count":33,"default_branch":"main","last_synced_at":"2025-05-11T05:17:55.342Z","etag":null,"topics":["data-warehouse","datawarehouse","postgres","postgresql","postgresql-extension"],"latest_commit_sha":null,"homepage":"","language":"C","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/hydradatabase.png","metadata":{"files":{"readme":"README.md","changelog":"CHANGELOG.md","contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2022-07-22T16:42:51.000Z","updated_at":"2025-05-10T08:07:06.000Z","dependencies_parsed_at":"2023-09-05T02:12:34.838Z","dependency_job_id":"4a042c29-b055-4b83-a1c5-279cd34cbb6e","html_url":"https://github.com/hydradatabase/columnar","commit_stats":{"total_commits":326,"total_committers":18,"mean_commits":18.11111111111111,"dds":0.7208588957055215,"last_synced_commit":"47354c2b576b0092786a5578049d998bd7c2287f"},"previous_names":["hydrasdb/hydra","hydradatabase/columnar"],"tags_count":12,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/hydradatabase%2Fcolumnar","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/hydradatabase%2Fcolumnar/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/hydradatabase%2Fcolumnar/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/hydradatabase%2Fcolumnar/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/hydradatabase","download_url":"https://codeload.github.com/hydradatabase/columnar/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":254052667,"owners_count":22006716,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["data-warehouse","datawarehouse","postgres","postgresql","postgresql-extension"],"created_at":"2025-02-11T01:02:30.021Z","updated_at":"2025-05-14T02:04:23.085Z","avatar_url":"https://github.com/hydradatabase.png","language":"C","funding_links":[],"categories":["C","HarmonyOS","\u003ca name=\"C\"\u003e\u003c/a\u003eC"],"sub_categories":["Windows Manager"],"readme":"[![Hydra - the open source data warehouse](https://raw.githubusercontent.com/hydradatabase/hydra/main/.images/header.png)](https://hydra.so)\n\n# 🐘🤘 Hydra Columnar\n\nHydra Colummnar is open source, column-oriented Postgres.\n\n## � Run locally\n\nThe [Docker image](https://github.com/hydradatabase/hydra/pkgs/container/hydra) is a drop-in replacement for [postgres Docker image](https://hub.docker.com/_/postgres).\n\nYou can try out Hydra locally using [docker-compose](https://docs.docker.com/compose/).\n\n```bash\ngit clone https://github.com/hydradatabase/columnar \u0026\u0026 cd columnar\ncp .env.example .env\ndocker compose up\npsql postgres://postgres:hydra@127.0.0.1:5432\n```\n\n## �💪 Benchmarks\n\nBenchmarks were run on a c6a.4xlarge (16 vCPU, 32 GB RAM) with 500 GB of GP2 storage.\nResults in seconds, smaller is better.\n\n![Hydra - the open source data warehouse](https://raw.githubusercontent.com/hydradatabase/hydra/main/.images/ReadmeBenchmarks.png)\n\n[Review Clickbench](https://tinyurl.com/clickbench) for comprehensive results and the list of 42 queries tested.\n\nThis benchmark represents typical workload in the following areas: clickstream and traffic analysis, web analytics, machine-generated data, structured logs, and events data.\n\n![Hydra - the open source data warehouse](https://raw.githubusercontent.com/hydradatabase/columnar/main/.images/FasterthanPG.png)\n\nFor our continuous benchmark results, see [BENCHMARKS](https://github.com/hydradatabase/hydra/blob/main/BENCHMARKS.md).\n\n## 🙋 FAQs\n\nView complete answers in [our documentation](https://columnar.docs.hydra.so/concepts/faqs).\n\n### Q: Why is Hydra so fast?\n\nA: Columnar storage, query parallelization, vectorized execution, column-level caching, and tuning Postgres.\n\n### Q: How do I start using the columnar format on Postgres?\n\nA: Data is loaded into columnar format by default. Use Postgres normally.\n\n### Q: What operations is Hydra meant for? Provide examples.\n\nA: Aggregates (COUNT, SUM, AVG), WHERE clauses, bulk INSERTS, UPDATE, DELETE…\n\n### Q: What is columnar not meant for?\n\nA: Frequent large updates, small transactions…\n\n### Q: What Postgres features are unsupported on columnar?\n\n* Logical replication.\n* Columnar tables don’t typically use indexes, only supporting btree and hash indexes, and their associated constraints.\n\n### Q: Is Hydra a fork?\n\nA: Hydra is a Postgres extension, not a fork. Hydra makes use of `tableam` (table access method API), which was added in Postgres 12 released in 2019.\n\n## 🤝 Community and Status\n\n- [x] Alpha: Limited to select design partners\n- [x] Public Alpha: available for use, but with noted frictions\n- [x] Hydra 1.0 beta: Stable for non-enterprise use cases\n- [x] Hydra 1.0 Release: Generally Available (GA) and ready for production use\n\n## :technologist: Developer resources\n\n- [CHANGELOG](https://github.com/hydradatabase/columnar/blob/main/CHANGELOG.md) for details of recent changes\n- [GitHub Issues](https://github.com/hydradatabase/columnar/issues) for bugs and missing features\n- [Docs](https://columnar.docs.hydra.so/) for Hydra features and warehouse ops\n\n## 📝 License\n\nHydra is only possible by building on the shoulders of giants.\n\nThe code in this repo is licensed under:\n\n- [AGPL 3.0](https://github.com/hydradatabase/hydra/tree/main/columnar/LICENSE) for [Hydra Columnar](https://github.com/hydradatabase/hydra/tree/main/columnar)\n- All other code is [Apache 2.0](https://github.com/hydradatabase/hydra/blob/main/LICENSE)\n\nThe docker image is built on the [Postgres docker image](https://hub.docker.com/_/postgres/), which contains a large number of open source projects, including:\n\n- Postgres - [the Postgres license](https://www.postgresql.org/about/licence/)\n- Debian or Alpine Linux image, depending on the image used\n- Hydra includes the following additional software in the image:\n    - multicorn - BSD license\n    - mysql_fdw - MIT-style license\n    - parquet_s3_fdw - MIT-style license\n    - pgsql-http - MIT license\n\nAs for any pre-built image usage, it is the image user's responsibility to ensure that any use of this image complies with any relevant licenses for all software contained within.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fhydradatabase%2Fcolumnar","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fhydradatabase%2Fcolumnar","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fhydradatabase%2Fcolumnar/lists"}