{"id":13425750,"url":"https://github.com/shunfei/indexr","last_synced_at":"2025-03-15T20:31:10.659Z","repository":{"id":41432444,"uuid":"77196845","full_name":"shunfei/indexr","owner":"shunfei","description":"An open-source columnar data format designed for fast \u0026 realtime analytic with big data.","archived":false,"fork":false,"pushed_at":"2022-11-16T05:23:54.000Z","size":2434,"stargazers_count":453,"open_issues_count":11,"forks_count":132,"subscribers_count":65,"default_branch":"master","last_synced_at":"2024-10-28T04:23:43.488Z","etag":null,"topics":["columnar-storage","datawarehouse","indexr","olap","realtime"],"latest_commit_sha":null,"homepage":"","language":"Java","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/shunfei.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2016-12-23T04:10:04.000Z","updated_at":"2024-08-17T13:49:55.000Z","dependencies_parsed_at":"2022-08-10T02:23:27.732Z","dependency_job_id":null,"html_url":"https://github.com/shunfei/indexr","commit_stats":null,"previous_names":[],"tags_count":25,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/shunfei%2Findexr","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/shunfei%2Findexr/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/shunfei%2Findexr/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/shunfei%2Findexr/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/shunfei","download_url":"https://codeload.github.com/shunfei/indexr/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":243790948,"owners_count":20348378,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["columnar-storage","datawarehouse","indexr","olap","realtime"],"created_at":"2024-07-31T00:01:18.019Z","updated_at":"2025-03-15T20:31:09.084Z","avatar_url":"https://github.com/shunfei.png","language":"Java","funding_links":[],"categories":["Java","Columnar Databases","`Columnar Databases`","大数据"],"sub_categories":[],"readme":"# IndexR\n\n![IndexR Logo](images/indexr-logo-150x150.png)\n\n**IndexR** is a super fast columnar data format on HDFS, which focus on fast analytic, both for massive static(historical) data and rapidly ingesting realtime data. IndexR is designed for OLAP. IndexR is greatly suitable for building data warehouse based on Hadoop ecosystem.\n\n* Super fast, 2~4x read speed of Parquet.\n* 3 levels indices supported. Say goodbye to full scan.\n* Support realtime ingestion. No more wait, analyse anything right after they happen.\n* Hardware efficiency, anyone can use.\n* Features like realtime and offline pre-aggregation, online schema update, 100% accurate, etc.\n* Deep integration with Hadoop ecosystem. Adapted with popular query engines like Apache Drill, Apache Hive, etc.\n\n#### Getting started\n\n* Installation\n  * First [Compile from source](https://github.com/shunfei/indexr/wiki/Compilation) or download a pre-compiled package directly from [release page](https://github.com/shunfei/indexr/releases).\n  * Then [Set up a cluster](https://github.com/shunfei/indexr/wiki/Deployment).\n* User manual - Check [here](https://github.com/shunfei/indexr/wiki/User-Guide).\n* Any problems? - Found an [issue](https://github.com/shunfei/indexr/issues).\n\n#### Documentation\n\n[https://github.com/shunfei/indexr/wiki](https://github.com/shunfei/indexr/wiki)\n\n#### Useful Links\n\n* [IndexR 技术白皮书](https://github.com/shunfei/sfmind/blob/master/indexr_white_paper/indexr_white_paper.md)\n* [IndexR introduction](https://github.com/shunfei/sfmind/blob/master/indexr.about.en.md)\n\nPlease feel free to file any issues.\n\n## Contact\n\n* WeChat: xilyflow\n* QQ Group: 606666586 (IndexR讨论组)\n\n## License\n\n    Copyright 2016 Sunteng Tech.\n\n    Licensed under the Apache License, Version 2.0 (the \"License\"); you may not\n    use this file except in compliance with the License. You may obtain a copy of\n    the License at\n\n    http://www.apache.org/licenses/LICENSE-2.0\n\n    Unless required by applicable law or agreed to in writing, software\n    distributed under the License is distributed on an \"AS IS\" BASIS, WITHOUT\n    WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the\n    License for the specific language governing permissions and limitations under\n    the License.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fshunfei%2Findexr","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fshunfei%2Findexr","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fshunfei%2Findexr/lists"}