https://github.com/github/rust-gems
A collection of rust algorithms and data structures
https://github.com/github/rust-gems
Last synced: 11 months ago
JSON representation
A collection of rust algorithms and data structures
- Host: GitHub
- URL: https://github.com/github/rust-gems
- Owner: github
- License: mit
- Created: 2023-10-11T09:43:38.000Z (over 2 years ago)
- Default Branch: main
- Last Pushed: 2025-03-26T08:25:12.000Z (12 months ago)
- Last Synced: 2025-03-26T08:35:02.928Z (12 months ago)
- Language: Rust
- Size: 33.6 MB
- Stars: 57
- Watchers: 6
- Forks: 7
- Open Issues: 3
-
Metadata Files:
- Readme: README.md
- Contributing: CONTRIBUTING.md
- License: LICENSE
- Code of conduct: CODE_OF_CONDUCT.md
- Codeowners: CODEOWNERS
- Security: SECURITY.md
- Support: SUPPORT.md
Awesome Lists containing this project
README
# Rust Algorithms
A collection of useful algorithms written in Rust. Currently contains:
- [`geo_filters`](crates/geo_filters): probabilistic data structures that solve the [Distinct Count Problem](https://en.wikipedia.org/wiki/Count-distinct_problem) using geometric filters.
- [`bpe`](crates/bpe): fast, correct, and novel algorithms for the [Byte Pair Encoding Algorithm](https://en.wikipedia.org/wiki/Large_language_model#BPE) which are particularly useful for chunking of documents.
- [`bpe-openai`](crates/bpe-openai): Fast tokenizers for OpenAI token sets based on the `bpe` crate.
- [`string-offsets`](crates/string-offsets): converts string positions between bytes, chars, UTF-16 code units, and line numbers. Useful when sending string indices across language boundaries.
## Background
**Rust Algorithms** is under active development and maintained by GitHub staff **AND THE COMMUNITY**.
See [CODEOWNERS](CODEOWNERS) for more details.
We will do our best to respond to support, feature requests, and community questions in a timely manner.
For more details see [support](SUPPORT.md) and [contribution](CONTRIBUTING.md) guidelines.
## Requirements
Requires a working installation of Rust [through download](https://www.rust-lang.org/learn/get-started) | [through Homebrew](https://formulae.brew.sh/formula/rustup-init)
## License
This project is licensed under the terms of the MIT open source license. Please refer to [MIT](LICENSE) for the full terms.