{"id":27103281,"url":"https://github.com/fgrzl/streams","last_synced_at":"2025-04-06T16:52:44.960Z","repository":{"id":282721949,"uuid":"942619336","full_name":"fgrzl/streams","owner":"fgrzl","description":"A basic streaming data store","archived":false,"fork":false,"pushed_at":"2025-04-01T19:22:23.000Z","size":121,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":0,"default_branch":"develop","last_synced_at":"2025-04-01T19:37:10.408Z","etag":null,"topics":["event-store","event-stream","streaming","streaming-data-pipelines"],"latest_commit_sha":null,"homepage":"","language":"Go","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/fgrzl.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":".github/CODEOWNERS","security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2025-03-04T11:50:40.000Z","updated_at":"2025-04-01T19:22:27.000Z","dependencies_parsed_at":"2025-03-25T17:36:24.514Z","dependency_job_id":null,"html_url":"https://github.com/fgrzl/streams","commit_stats":null,"previous_names":["fgrzl/river","fgrzl/streams"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/fgrzl%2Fstreams","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/fgrzl%2Fstreams/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/fgrzl%2Fstreams/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/fgrzl%2Fstreams/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/fgrzl","download_url":"https://codeload.github.com/fgrzl/streams/tar.gz/refs/heads/develop","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":247517943,"owners_count":20951718,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["event-store","event-stream","streaming","streaming-data-pipelines"],"created_at":"2025-04-06T16:52:44.356Z","updated_at":"2025-04-06T16:52:44.946Z","avatar_url":"https://github.com/fgrzl.png","language":"Go","funding_links":[],"categories":[],"sub_categories":[],"readme":"[![ci](https://github.com/fgrzl/kv/actions/workflows/ci.yml/badge.svg)](https://github.com/fgrzl/kv/actions/workflows/ci.yml)\n[![Dependabot Updates](https://github.com/fgrzl/kv/actions/workflows/dependabot/dependabot-updates/badge.svg)](https://github.com/fgrzl/kv/actions/workflows/dependabot/dependabot-updates)\n\n# Streams  \n[](url)\n\n#### Organizing Streams: Spaces and Segments  \nStreams uses a hierarchical model—**Spaces** and **Segments**—to efficiently manage and consume high-throughput event data.\n\n### Spaces  \nA **Space** is a top-level logical container for related streams.\n\n- Groups streams by application, data type, or service  \n- Enables broad categorization and easier management  \n- Consumers can subscribe to an entire Space for interleaved events from all Segments  \n\n### Segments  \n**Segments** are independent, ordered sub-streams within a Space.\n\n- Maintain strict event order  \n- Support parallel consumption for scalability  \n- Identified uniquely within their Space  \n\n### How It Works  \n\n- **Producing**: Data is written to specific Segments in a Space  \n- **Consuming**:  \n  - Subscribe to a Space for all Segments (interleaved)  \n  - Subscribe to a Segment for strict ordering  \n- **Peeking**: Read the latest entry in a Segment without consuming it  \n- **Offsets \u0026 Transactions**:  \n  - Offsets track consumer progress  \n  - Transactions ensure consistent writes  \n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Ffgrzl%2Fstreams","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Ffgrzl%2Fstreams","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Ffgrzl%2Fstreams/lists"}