{"id":16821010,"url":"https://github.com/felixmcfelix/streamcatcher","last_synced_at":"2025-07-30T23:17:26.716Z","repository":{"id":47470875,"uuid":"284363331","full_name":"FelixMcFelix/streamcatcher","owner":"FelixMcFelix","description":"A Rust thread-safe, shared (asynchronous) stream buffer designed to lock only on accessing and storing new data.","archived":false,"fork":false,"pushed_at":"2021-12-27T14:59:20.000Z","size":201,"stargazers_count":6,"open_issues_count":0,"forks_count":2,"subscribers_count":3,"default_branch":"stable","last_synced_at":"2025-04-08T23:12:51.697Z","etag":null,"topics":["async","bytestreams","caching","concurrency","concurrent-data-structure","rust"],"latest_commit_sha":null,"homepage":"","language":"Rust","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/FelixMcFelix.png","metadata":{"files":{"readme":"README.md","changelog":"CHANGELOG.md","contributing":"CONTRIBUTING.md","funding":null,"license":"LICENSE-APACHE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2020-08-02T00:39:56.000Z","updated_at":"2023-03-18T01:18:44.000Z","dependencies_parsed_at":"2022-08-27T02:30:35.247Z","dependency_job_id":null,"html_url":"https://github.com/FelixMcFelix/streamcatcher","commit_stats":null,"previous_names":[],"tags_count":5,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/FelixMcFelix%2Fstreamcatcher","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/FelixMcFelix%2Fstreamcatcher/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/FelixMcFelix%2Fstreamcatcher/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/FelixMcFelix%2Fstreamcatcher/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/FelixMcFelix","download_url":"https://codeload.github.com/FelixMcFelix/streamcatcher/tar.gz/refs/heads/stable","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":248333604,"owners_count":21086200,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["async","bytestreams","caching","concurrency","concurrent-data-structure","rust"],"created_at":"2024-10-13T10:58:50.116Z","updated_at":"2025-04-11T03:10:28.346Z","avatar_url":"https://github.com/FelixMcFelix.png","language":"Rust","funding_links":[],"categories":[],"sub_categories":[],"readme":"[![docs-badge][]][docs] [![crates.io version][]][crates.io link] [![crates.io downloads][]][crates.io link] [![license][]][license link] [![build badge]][build]\n\n# Streamcatcher\nA Rust thread-safe, shared (asynchronous) stream buffer designed to lock only on accessing and storing new data.\n\nStreamcatcher is designed to allow seeking on otherwise one-way streams (*e.g.*, command output) whose output needs to be accessed by many threads without constant reallocations, contention over safe read-only data, or unnecessary stalling. Only threads who read in *new data* ever need to lock the data structure, and do not prevent earlier reads from occurring.\n\n## Features\n* Lockless access to pre-read data and finished streams.\n* Transparent caching of newly read data.\n* Allows seeking on read-only bytestreams.\n* Piecewise allocation to reduce copying and support unknown input lengths.\n* Optional acceleration of reads on stream completion by copying to a single backing store.\n* (Stateful) bytestream transformations.\n* Async support with the `\"async\"` feature, and runtimes via [`\"async-std-compat\"`, `\"smol-compat\"`, `\"tokio-compat\"`].\n\nThe main algorithm is outlined in [this blog post], with rope reference tracking moved to occur only in the core.\n\n## License\n\nLicensed under either of\n\n * Apache License, Version 2.0\n   ([LICENSE-APACHE](LICENSE-APACHE) or http://www.apache.org/licenses/LICENSE-2.0)\n * MIT license\n   ([LICENSE-MIT](LICENSE-MIT) or http://opensource.org/licenses/MIT)\n\nat your option.\n\n## Contribution\n\nUnless you explicitly state otherwise, any contribution intentionally submitted\nfor inclusion in the work by you, as defined in the Apache-2.0 license, shall be\ndual licensed as above, without any additional terms or conditions.\n\nDetailed guidelines are given in [the CONTRIBUTING file].\n\n[this blog post]: https://mcfelix.me/blog/shared-buffers/\n[the CONTRIBUTING file]: CONTRIBUTING.md\n\n[build badge]: https://img.shields.io/github/workflow/status/FelixMcFelix/streamcatcher/Build%20and%20Test%20(Stable)?style=flat-square\n[build]: https://github.com/FelixMcFelix/streamcatcher/actions\n\n[docs-badge]: https://img.shields.io/badge/docs-online-4d76ae.svg?style=flat-square\n[docs]: https://docs.rs/streamcatcher\n\n[crates.io link]: https://crates.io/crates/streamcatcher\n[crates.io version]: https://img.shields.io/crates/v/streamcatcher.svg?style=flat-square\n[crates.io downloads]: https://img.shields.io/crates/d/streamcatcher.svg?style=flat-square\n\n[license]: https://img.shields.io/crates/l/streamcatcher?style=flat-square\n[license link]: https://opensource.org/licenses/Apache-2.0","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Ffelixmcfelix%2Fstreamcatcher","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Ffelixmcfelix%2Fstreamcatcher","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Ffelixmcfelix%2Fstreamcatcher/lists"}