{"id":37175081,"url":"https://github.com/bartke/datastream","last_synced_at":"2026-01-14T20:27:03.814Z","repository":{"id":65770636,"uuid":"589937450","full_name":"bartke/datastream","owner":"bartke","description":"pattern for one consistent interface for requesting, propagating and receiving real-time data updates","archived":false,"fork":false,"pushed_at":"2023-02-10T08:47:14.000Z","size":67,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"master","last_synced_at":"2024-08-11T06:44:41.502Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":"","language":"Go","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/bartke.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2023-01-17T09:44:47.000Z","updated_at":"2023-02-10T08:48:53.000Z","dependencies_parsed_at":null,"dependency_job_id":"ce907e88-03d4-4ec5-bf41-431753d765d9","html_url":"https://github.com/bartke/datastream","commit_stats":{"total_commits":29,"total_committers":1,"mean_commits":29.0,"dds":0.0,"last_synced_commit":"cdf7b822048dfa8b4aaf6a493557c91edf68bf5a"},"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/bartke/datastream","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/bartke%2Fdatastream","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/bartke%2Fdatastream/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/bartke%2Fdatastream/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/bartke%2Fdatastream/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/bartke","download_url":"https://codeload.github.com/bartke/datastream/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/bartke%2Fdatastream/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":28434456,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-01-14T18:57:19.464Z","status":"ssl_error","status_checked_at":"2026-01-14T18:52:48.501Z","response_time":107,"last_error":"SSL_connect returned=1 errno=0 peeraddr=140.82.121.6:443 state=error: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2026-01-14T20:27:03.152Z","updated_at":"2026-01-14T20:27:03.806Z","avatar_url":"https://github.com/bartke.png","language":"Go","funding_links":[],"categories":[],"sub_categories":[],"readme":"[![Go Reference](https://pkg.go.dev/badge/github.com/bartke/datastream.svg)](https://pkg.go.dev/github.com/bartke/datastream)\n[![Go Report Card](https://goreportcard.com/badge/github.com/bartke/datastream)](https://goreportcard.com/report/github.com/bartke/datastream)\n\n# datastream\n\nDatastream is a gRPC service definition that provides a consistent interface for\nrequesting, propagating and receiving real-time data updates. It aims to be a\nsimple interface for a common set of problems around use cases such as\nconfiguration management, real-time data such as exchange rates, notification\nsubscribers, file management and similar.\n\n- `ListCapabilities`: lists available keys for subscription\n- `Sync`: sync with a server and receive the current state\n- `Subscribe`: subscribe to the data stream and receive updates, initially syncs all keys\n- `PushUpdate`: if supported, update and push a value update back on the server\n\nNote: Make sure you have installed protoc and the Go protobuf plugin on your system.\n\n## Backing stores\n\nA storage interface and datastream grpc implementation example exists for\n- **git repository** - key=file path, value=file content\n- **sqlite3** - key=table column, value=table column\n- **postgresql** - key=table column, value=table column\n- **S3/minio compatible storage** - key=path, valu=file content\n\nThere is also a freestanding settings server implementation example using\nsqlite3 with a local gRPC service implementation under `examples/server/` and a\nself-communication example.\n\n## Examples\n\nThe example setting service shows how a datastream service can be used to\nrequesting, subscribing and push updates.\n\n```sh\nmake\n./server \u0026\n./client \u0026\n./updater\nkill %1 # also terminates the client\n```\n\nserver\n```\n2023/01/17 18:58:05 Starting gRPC server on :8080\n2023/01/17 18:58:08 method: /datastream.DataService/ListCapabilities, duration: 190.625µs, error: \u003cnil\u003e\n2023/01/17 18:58:12 method: /datastream.DataService/PushUpdate, duration: 1.05157ms, error: \u003cnil\u003e\n```\n\nclient\n```\n2023/01/17 18:58:08 Capabilities: [key:\"max_connections\" value_type:\"int\" key:\"rate_limit\" value_type:\"int\" key:\"debug_enabled\" value_type:\"bool\"]\n2023/01/17 18:58:08 Subscribing to key: max_connections\n2023/01/17 18:58:08 Received update for key max_connections value [49 48], stringified data 10\n2023/01/17 18:58:12 Received update for key max_connections value [50 48], stringified data 20\n```\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fbartke%2Fdatastream","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fbartke%2Fdatastream","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fbartke%2Fdatastream/lists"}