https://github.com/codepr/shoju

https://github.com/codepr/shoju

Last synced: 5 months ago
JSON representation

• Host: GitHub
• URL: https://github.com/codepr/shoju
• Owner: codepr
• License: mit
• Created: 2023-09-26T21:03:26.000Z (over 2 years ago)
• Default Branch: main
• Last Pushed: 2024-12-09T18:10:14.000Z (over 1 year ago)
• Last Synced: 2024-12-09T19:21:40.346Z (over 1 year ago)
• Language: Rust
• Size: 49.8 KB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

          
Shoju

=====

A simplified implementation of a Kafka like library, a lightweight append-only commit log system

that behaves similarly to Kafka, in a pull-oriented mechanism based on offsets  and keys for ordering to (re)play a stream of events.

### On the radar

Non exhaustive and definitely underloved roadmap.

- CRC32 of the payloads

- Reduce insane IO, write in batches

- Iterator, batch size to read efficiently

- Log compaction

- Multiple partitions per topic

- Retention