https://github.com/farbodahm/streame
Streame is going to be a fault tolerant stream processor, Eventually!
https://github.com/farbodahm/streame
Last synced: 7 months ago
JSON representation
Streame is going to be a fault tolerant stream processor, Eventually!
- Host: GitHub
- URL: https://github.com/farbodahm/streame
- Owner: farbodahm
- Created: 2024-03-11T20:04:23.000Z (over 1 year ago)
- Default Branch: main
- Last Pushed: 2024-05-22T14:34:12.000Z (about 1 year ago)
- Last Synced: 2024-05-22T22:46:27.166Z (about 1 year ago)
- Language: Go
- Size: 74.2 KB
- Stars: 4
- Watchers: 1
- Forks: 0
- Open Issues: 8
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# Streame
- [Streame](#streame)
- [Status Tracker](#status-tracker)
- [Benchmarks](#benchmarks)
- [Available Functionalities](#available-functionalities)
- [Final Workflow Expectations](#final-workflow-expectations)
- [Contributions](#contributions)
Streame is going to be a fault tolerant stream processor, Eventually!
## Status Tracker
You can track the roadmap and in-progress features of Streame
on [Streame Status Tracker](https://github.com/users/farbodahm/projects/1).
## Benchmarks
Streame emphasizes the importance of benchmarks, as nothing is reliable
without numbers.
Each core functionality will have benchmark tests in `benchmarks` module.
These benchmarks are integrated into our CI process, ensuring automatic
execution.
Additionally, detailed SVG reports on Memory and CPU performance,
generated using pprof, are automatically uploaded to the artifacts
section of each CI pipeline run.
## Available Functionalities
- [x] Schema Validation
- [x] Filter
- [x] Select
- [x] Add static column
- [x] Add column rename
- [ ] Join
- [ ] Aggregation
## Final Workflow Expectations
Thinking loudly, here I will write all of the requirements that I
expect to be added to the main framework somewhere in the future
shortly after having the main functionalities in place.
- Orchestration (Ex. K8S, DockerSwarm, …)
- Monitoring
- Unit & Integration tests
- Load Test (Ex. K6S)
- Fault Tolerance Test (Ex. chaos-mesh)
## Contributions
This project is getting started as fun and for learning; and it may
end up in something important to be used on Production; So feel free
to contribute to it as you like ;)
You can find the roadmap [here](https://github.com/users/farbodahm/projects/1).