{"id":26401502,"url":"https://github.com/hermya/cs511_breolap","last_synced_at":"2026-02-25T20:02:20.576Z","repository":{"id":230462925,"uuid":"778627052","full_name":"hermya/cs511_BReOLAP","owner":"hermya","description":"Realtime-OLAPs can be used to analyze of high-velocity data. We aim to benchmark ReOLAPs with respect to critical financial use-cases.","archived":false,"fork":false,"pushed_at":"2025-02-10T22:16:10.000Z","size":10195,"stargazers_count":2,"open_issues_count":0,"forks_count":1,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-04-03T10:51:26.600Z","etag":null,"topics":["benchmarking","clickhouse","docker","druid","fintech","grafana","kafka","olap","pinot","prometheus","python","sql","starrocks"],"latest_commit_sha":null,"homepage":"","language":"Jupyter Notebook","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/hermya.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2024-03-28T04:36:02.000Z","updated_at":"2025-03-26T02:56:10.000Z","dependencies_parsed_at":"2025-02-10T23:29:49.477Z","dependency_job_id":null,"html_url":"https://github.com/hermya/cs511_BReOLAP","commit_stats":null,"previous_names":["hermya/cs511_breolap"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/hermya/cs511_BReOLAP","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/hermya%2Fcs511_BReOLAP","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/hermya%2Fcs511_BReOLAP/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/hermya%2Fcs511_BReOLAP/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/hermya%2Fcs511_BReOLAP/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/hermya","download_url":"https://codeload.github.com/hermya/cs511_BReOLAP/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/hermya%2Fcs511_BReOLAP/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":29837448,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-02-25T19:08:47.527Z","status":"ssl_error","status_checked_at":"2026-02-25T18:59:04.705Z","response_time":61,"last_error":"SSL_connect returned=1 errno=0 peeraddr=140.82.121.6:443 state=error: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["benchmarking","clickhouse","docker","druid","fintech","grafana","kafka","olap","pinot","prometheus","python","sql","starrocks"],"created_at":"2025-03-17T14:51:59.770Z","updated_at":"2026-02-25T20:02:20.540Z","avatar_url":"https://github.com/hermya.png","language":"Jupyter Notebook","readme":"# BReOLAP: Your Fintech Realtime-OLAP Solution 🚀\n\nFintech organizations require an OLAP solution that can resolve complex analytical queries in milliseconds, enabling them to make informed, split-second decisions. Choosing the right Realtime-OLAP is crucial, and **BReOLAP** is here to guide you through selecting the best option for your specific needs! Check out **[this](https://lnkd.in/gQDAbzTF)** formal report for our end-to-end scientific study\n\n----\n## 🎯 Purpose\n\nOur goal at BReOLAP is multi-fold:\n- **Model Definition:** We define a model where specific requirements dictate the choice of database.\n- **Benchmarking Insights:** Demonstrate our methodology for benchmark comparisons.\n- **System Replication:** Provide insights into replicating contemporary systems for your use.\n\n## 🏅 Candidate Realtime-OLAP\n\nWe've rigorously tested the following Realtime-OLAPs to ensure you get reliable, actionable insights:\n\n| \u003cimg src=\"https://cdn.brandfetch.io/idnezyZEJm/w/400/h/400/theme/dark/icon.jpeg?c=1bx1741846904095id64Mup7acT2007dvU\u0026t=1684474240695\" width=\"100\"\u003e \u003cbr\u003e **ClickHouse** | \u003cimg src=\"https://cdn.prod.website-files.com/62ccab534b634e946221774e/632ca26c3a7f081704214125_pinot_team.jpeg\" width=\"100\"\u003e \u003cbr\u003e **Pinot** |\n|---------------------------------------------|------------------------------------------|\n| \u003cimg src=\"https://pbs.twimg.com/profile_images/491968662899658752/F65UpOhT_400x400.png\" width=\"100\"\u003e \u003cbr\u003e **Druid** | \u003cimg src=\"https://avatars.githubusercontent.com/u/78232517?s=200\u0026v=4\" width=\"100\"\u003e \u003cbr\u003e **StarRocks** |\n\n\n\n### 🚧 In Progress\nWe are also in the process of evaluating these promising databases:\n* **Doris**\n* **Kylin**\n\n# Flow of data\n\n```mermaid\ngraph TD;\n    \n    subgraph ClickHouse \u0026 StarRocks\n        A[data-source] --\u003e|Kafka| B[sink-connector]\n        subgraph DB1[Database]\n            F[node] \u003c--\u003e C[controller] \u003c--\u003e D[node] \n        end\n        B --\u003e DB1\n        DB1 --\u003e|Processed Data| E[Query Engine \u0026 Ingestion Verifier]\n    end\n\n    subgraph Druid \u0026 Pinot\n        G[data-source] --\u003e|Kafka| H[internal-stream-ingestor]\n        subgraph DB2[Database]\n            I[controller] \u003c--\u003e J[node] \u003c--\u003e Q[historical-nodes] \n        end\n        H --\u003e DB2\n        DB2 --\u003e|Processed Data| K[Query Engine \u0026 Ingestion Lag Tracer]\n    end\n```\n---\n\n## 🛠️ Deep Dive into Our Technology\n\nWe're ready to answer your questions immediately! For those interested in a deeper understanding, here's how we equip you with the best tools:\n\n- **Distributed Systems Setup:** Learn how we configure each candidate database to function efficiently in a distributed environment.\n- **Table Definitions:** Discover how we define tables to run benchmark tests effectively.\n- **Data Stream Integration:** See how we set up input streams to simulate real-time data flow.\n- **Query Execution:** Understand our configurations for running queries and retrieving results smoothly.\n- **Monitoring and Metrics:** Explore our setup with Prometheus and Grafana for real-time metrics collection.\n\nFeel free to explore our [Documentation](#) for detailed guides and setups.\n\n## 📢 Stay Tuned\n\nFor updates, further details, and live results, keep an eye on this space! We're constantly working to expand our insights and tools to help you stay ahead in the fast-paced world of Fintech.\n\n---\n\nWe're excited to help you navigate the complex landscape of Realtime-OLAP solutions. With BReOLAP, you're not just choosing a tool; you're setting the stage for future-proof financial analytics!\n\n","funding_links":[],"categories":[],"sub_categories":[],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fhermya%2Fcs511_breolap","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fhermya%2Fcs511_breolap","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fhermya%2Fcs511_breolap/lists"}