{"id":19561255,"url":"https://github.com/srgchrksv/stream-crypto","last_synced_at":"2026-04-30T11:36:04.335Z","repository":{"id":226303119,"uuid":"767745804","full_name":"srgchrksv/stream-crypto","owner":"srgchrksv","description":"Crypto trades streaming with azure services","archived":false,"fork":false,"pushed_at":"2024-03-06T21:53:10.000Z","size":318,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-02-26T08:43:55.577Z","etag":null,"topics":["azure","binance","crypto","data","databricks","dataengineering","pyspark","python","streaming","websocket"],"latest_commit_sha":null,"homepage":"","language":"Jupyter Notebook","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/srgchrksv.png","metadata":{"files":{"readme":"readme.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null}},"created_at":"2024-03-05T20:32:51.000Z","updated_at":"2024-03-06T10:55:30.000Z","dependencies_parsed_at":"2024-03-06T22:51:18.267Z","dependency_job_id":"3faa9157-d0c4-44ce-8654-78885c280ea6","html_url":"https://github.com/srgchrksv/stream-crypto","commit_stats":null,"previous_names":["srgchrksv/stream-crypto"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/srgchrksv/stream-crypto","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/srgchrksv%2Fstream-crypto","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/srgchrksv%2Fstream-crypto/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/srgchrksv%2Fstream-crypto/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/srgchrksv%2Fstream-crypto/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/srgchrksv","download_url":"https://codeload.github.com/srgchrksv/stream-crypto/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/srgchrksv%2Fstream-crypto/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":32463892,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-04-29T22:27:22.272Z","status":"online","status_checked_at":"2026-04-30T02:00:05.929Z","response_time":57,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["azure","binance","crypto","data","databricks","dataengineering","pyspark","python","streaming","websocket"],"created_at":"2024-11-11T05:10:16.199Z","updated_at":"2026-04-30T11:36:04.074Z","avatar_url":"https://github.com/srgchrksv.png","language":"Jupyter Notebook","funding_links":[],"categories":[],"sub_categories":[],"readme":"## Streaming crypto trades data\n\nGot a python script that consumes trades data from binance and produces messages to azure eventhubs.\n\nDatabricks notebook processes eventhubs with pyspark and writes delta tables.\n\nPower BI using partner connect to Databricks streams and visualize data\n\n### Streaming system\n![\"Stream\"](/docs/stream.png)\n\n## Silver layer table\n![\"Silver Layer Table\"](/docs/silver-layer.png)\nThe gold layer of this stream system holds separate table for each symbol\n\n## PowerBI  databricks streaming visualizations\n![\"Power BI Of Silver Layer Table\"](/docs/powerbi.png)\n\nUseful links: \n- [https://github.com/malvik01/Real-Time-Streaming-with-Azure-Databricks](https://github.com/malvik01/Real-Time-Streaming-with-Azure-Databricks)\n- [https://www.youtube.com/watch?v=pwWIegHgNRw](https://www.youtube.com/watch?v=pwWIegHgNRw)\n- [https://github.com/binance/binance-spot-api-docs/blob/master/web-socket-streams.md](https://github.com/binance/binance-spot-api-docs/blob/master/web-socket-streams.md)","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fsrgchrksv%2Fstream-crypto","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fsrgchrksv%2Fstream-crypto","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fsrgchrksv%2Fstream-crypto/lists"}