Projects in Awesome Lists tagged with stream-processing
A curated list of projects in awesome lists tagged with stream-processing .
https://github.com/ibmstreams/streamsx.objectstorage
The com.ibm.streamsx.objectstorage toolkit supports Object Storage services with S3 API like IBM Cloud Object Storage service.
ibm-streams object-storage stream-processing toolkit
Last synced: 14 Jun 2025
https://github.com/ibmstreams/streamsx.jdbc
Supports Streams application to work with databases via JDBC
database db2 ibm-streams jdbc stream-processing toolkit
Last synced: 09 Mar 2026
https://github.com/relvaner/nodes4j-core
Framework for parallel processing based on Actor4j. Useful for data analysis.
actor actor-model actor4j actors batch-processing data-analysis graph-processing java java-17 message-passing parallelization reactive-system stream-processing
Last synced: 14 Jul 2025
https://github.com/dannycho7/express-form-post
Simple and efficient nodejs http file upload middleware.
busboy dropbox expressjs file-parser file-upload multipart-data multipart-uploads nodejs nodejs-modules s3-storage stream-processing streaming-data
Last synced: 02 Mar 2026
https://github.com/nsstc/data-drift
Data streaming and scheduling library for Node.JS
data-pipeline data-transformation node-js node-module nodejs nodejs-modules stream stream-processing streaming streams
Last synced: 14 May 2026
https://github.com/slgobinath/wisdom
An adaptive and self-boosting stream processor
cep complex-event-processing data-analysis distributed self-tuning stream-processing wisdom
Last synced: 14 Apr 2025
https://github.com/ibmstreams/streamsx.dps
The IBMStreams/streamsx.dps GitHub repository is home to the Streams toolkit named DPS (Distributed Process Store)
distributed-computing ibm-streams stream-processing toolkit
Last synced: 08 Mar 2026
https://github.com/ibmstreams/streamsx.adaptiveparser
(Incubation) The toolkit allows to parse input format producing desired hierarchical tuple (including lists, maps and sets) saving the common step of mapping the flat format to the required Streams tuple.
clf ibm-streams json-parser parser stream-processing
Last synced: 15 Jul 2025
https://github.com/nastel/jesl
jKool Event Streaming Library -- telemetry collection, simulation and streaming to jKool enabled servers, jKool Cloud.
java jkool-cloud stream-events stream-processing streaming-data
Last synced: 10 Aug 2025
https://github.com/brian-lau/frequentdirections
Matlab implementation of Frequent Directions variants for matrix sketching
approximation linear-algebra matlab matrix-sketching stream-processing
Last synced: 18 Jun 2025
https://github.com/pierrekieffer/multiprocessing-template
Provides parallel and async execution of multiple methods, and processing of results in real time.
async asynchronous asynchronous-programming multiprocessing parallel-programming stream-processing
Last synced: 31 Mar 2025
https://github.com/thpham/datapipe
POC: Real time analytics pipeline
analytics druid kafka kafka-connect protobuf real-time stream-processing superset
Last synced: 31 Jan 2026
https://github.com/spiredb/spiredb
SpireDB - Stream -> Store -> Scale.
distributed-database elixir-lang erlang kv-store oltp rust-lang spiredb spiresql sql stream-processing vector-search
Last synced: 21 Feb 2026
https://github.com/ibmstreams/streamsx.json
Toolkit for working with JSON in SPL applications.
ibm-streams java json parser stream-processing toolkit
Last synced: 15 Jul 2025
https://github.com/rosscartlidge/ssql
SQL-style stream processing for the command line and Go
cli csv data-processing duckdb go golang pipeline sql stream-processing unix wasm
Last synced: 07 May 2026
https://github.com/powersemmi/ruststream
An async messaging framework for Rust
asyncapi distributed-systems rust stream-processing
Last synced: 07 Jun 2026
https://github.com/carverauto/eventrunner
high-speed opensource event processing engine
cassandra go gofr iot iot-platform message-processing nats-jetstream scylladb stream-processing wasm wasmcloud
Last synced: 31 Aug 2025
https://github.com/mzabaluev/tokio-text
Utilities for text-oriented asynchronous I/O in the Tokio framework.
async asynchronous asyncio encoding-convertors input-output rust rust-library stream-processing text tokio-rs
Last synced: 07 Jan 2026
https://github.com/csp-community/csp-adapter-discord
A csp adapter for discord
chat chatbot cpp discord discord-py discordpy python reactive reactive-programming stream-processing streaming
Last synced: 08 Apr 2026
https://github.com/am-kantox/lazy_for
Lazy implementation of `Kernel.SpecialForms.for/1` based on streams
comprehension elixir elixir-lang stream stream-processing
Last synced: 26 Mar 2025
https://github.com/csp-community/csp-bot-commands
Miscellaneous commands for csp-bot
chat chatbot csp discord python reactive reactive-programming slack stream-processing streaming symphony
Last synced: 23 Apr 2026
https://github.com/ccamel/poc-piper-worker-flink
:alembic: An experiment to make flink a worker for the workflow engine piper
amqp flink rabbitmq stream-processing worker workflow-engine
Last synced: 13 Apr 2025
https://github.com/cedrickchee/nodejs-in-depth
Master and understand deeper Node.js fundamentals and internals
child-process event-emitter fundamentals in-depth node-js-clusters nodejs nodejs-stream stream-processing
Last synced: 19 Apr 2026
https://github.com/irc-sphere/hyperstreamonlinelearning
Plugins for Online Learning (supervised or unsupervised) in HyperStream
hyperstream machine-learning online-learning stream-processing supervised-learning unsupervised-learning
Last synced: 02 Apr 2025
https://github.com/sulunemre/twitch-stream-analytics
A stream processing project that analyzes the chat stream of a Twitch channel. Built on Apache Storm for CS442 Distributed Systems course.
apache-storm emoticons stream-processing twitch twitch-api
Last synced: 11 Mar 2025
https://github.com/ibmstreams/streamsx.cassandra
Operators for Cassandra
cassandra cassandra-table ibm-streams stream-processing
Last synced: 19 May 2026
https://github.com/vonzhou/storm-examples
学习Storm的示例， Examples To Learn Storm
java kafka redis storm stream-processing
Last synced: 15 May 2026
https://github.com/krzysbaranski/kcache
Cache Library in Python
cache lifecycle python python3 stream-processing
Last synced: 14 Jan 2026
https://github.com/ostafen/hermes
EventStoreDB-like stream projections on top of Apachi Kafka.
event-driven event-sourcing eventstoredb javascript kafka kafka-streams projections-system stream-processing
Last synced: 12 Apr 2025
https://github.com/gfleury/gstreamtop
Real time analytical SQL Query on text streams
aggregation analytics interactive real-time regex sql stream-processing text
Last synced: 10 Mar 2026
https://github.com/geraked/bigdata
Implementation of Big Data Analytics Algorithms in Python
amirkabir-university association-rules big-data big-data-analytics bigdata collaborative-filtering cs246 data-mining data-science frequent-itemset-mining friendship-algorithm geraked graph kmeans-clustering locality-sensitive-hashing rabist recommender-system stanford-course stream-processing triangle-counting
Last synced: 07 Sep 2025
https://github.com/perguard/pg-streaming-performance-data
Data collection, feature engineering and machine learning of performance traces
avro docker docker-compose java kafka kafka-streams machine-learning python scikit-learn scikit-multiflow skmultiflow stream-processing streaming-data telegraf zipkin
Last synced: 10 Apr 2026
https://github.com/ibmstreams/streamsx.speech2text
(incubation) Provides ability to transform speech to text in a Streams application
ibm-streams speech-to-text speech2text stream-processing
Last synced: 15 Jul 2025
https://github.com/ibmstreams/streamsx.edgevideoanalytics.starterkit
An end-to-end video analytic demonstration performing video analytics on edge devices and centralized system
edge-devices iot starterkit stream-processing video-analytics
Last synced: 15 Jul 2025
https://github.com/eliias/gleam
Fun DSL for Apache Beam and Kotlin.
apache-beam data-engineering stream-processing
Last synced: 18 Oct 2025
https://github.com/wittline/optimizing-public-transportation
Streaming event pipeline around Apache Kafka and its ecosystem. Using public data from the Chicago Transit Authority we will construct an event pipeline around Kafka that allows us to simulate and display the status of train lines in real time.
kafka stream-processing streaming udacity-nanodegree
Last synced: 24 Mar 2025
https://github.com/nextorigin/riemann-query-parser
Query parser extracted from Riemann and ported from Clojure to Node
antlr antlr4 clojure coffeescript godot2 lisp nodejs riemann sanitizer stream-processing streams streams2 streams3
Last synced: 01 Mar 2026
https://github.com/ibmstreams/streamsx.network
Toolkit for working with network data
cybersecurity ibm-streams network-analysis network-monitoring stream-processing toolkit
Last synced: 15 Jul 2025
https://github.com/bufferapp/cerone
Extensible consumer made for applications using Amazon's Kinesis Python Client Library (KCL).
kcl kinesis-stream stream-processing
Last synced: 08 Apr 2026
https://github.com/lapetitesouris/kafkastreaming
Simple stream-processing data pipeline in Kafka
data-engineering kafka kafka-streams kafka-topic pipeline stream-processing streaming-data
Last synced: 18 Jul 2025
https://github.com/timkpaine/csp-adapter-discord
A csp adapter for discord
chat chatbot cpp discord discord-py discordpy python reactive reactive-programming stream-processing streaming
Last synced: 14 Apr 2025
https://github.com/bytefish/flinkexperiments
Experiments with Apache Flink.
elasticsearch flink postgresql stream-processing
Last synced: 21 Feb 2026
https://github.com/improveTheWorld/DataFlow.NET
Unified sync/async stream processing with category-based filtering. Single API for IEnumerable/IAsyncEnumerable with Cases/SelectCase/ForEachCase pattern. Eliminates Rx complexity, enables elegant pipeline composition for real-time data processing.
async-await async-enumerable category-filtering csharp data-streaming dotnet event-processing fluent-api functional-programming linq-extensions observables-alternative pipeline-composition- reactive-programming stream-processing
Last synced: 17 Jul 2025
https://github.com/ibmstreams/streamsx.cdc
(Incubation) This toolkit receives live changes from a InfoSphere Data replication CDC subscription which can then be used as part of the Streams application to trigger events or update reference tables.
cdc ibm-streams replication stream-processing
Last synced: 15 Jul 2025
https://github.com/rudeigerc/streaming-reading
Reading List for Stream Processing
paper-reading reading-list stream-processing
Last synced: 24 Feb 2026
https://github.com/bbonnin/talk-stream-processing-et-sql
Support pour un talk sur le stream processing avec SQL
sql stream stream-processing streaming
Last synced: 30 Jan 2026
https://github.com/ankur-paan/ekuiper-manager
Open-source eKuiper Manager UI - The first community-driven web interface for LF Edge eKuiper
edge-computing ekuiper iiot iot manager-ui mqtt stream-processing
Last synced: 26 Jan 2026
https://github.com/cntryl/fitz
Unified broker for KV, queue, notice, RPC, lease, stream, and schedule messaging patterns.
event-driven key-value-store message-broker pubsub queue rpc rust scheduler stream-processing tcp websocket
Last synced: 09 Jun 2026
https://github.com/chinalhr/go-stream
Use Go to implement Java Stream API
golang library stream stream-processing
Last synced: 02 Feb 2026
https://github.com/romnn/flink-kafka-protobuf
Minimal working example of protobuf models streamed from kafka into a flink pipeline.
cep deserialization event-driven example-repo flink kafka kafkaconnector protobuf serialization stream-processing
Last synced: 19 Apr 2026
https://github.com/whardier/ssh-mole
SSH Agent Back Channel Tools
file-sharing ssh ssh-agent stream-processing
Last synced: 16 Jul 2025
https://github.com/nextbreakpoint/flink-workshop
Example of Flink jobs for workshop (work in progress)
Last synced: 08 Jul 2025
https://github.com/sachaarbonel/multi_stream_controller
A way to easily pipe your streams into one controller
Last synced: 11 Jan 2026
https://github.com/nikolaydubina/go-bench-stream
🌊 Go Benchmarks for Stream Processing
benchmarks go stream-processing streaming
Last synced: 02 Mar 2026
https://github.com/1995parham-learning/beam
Learn how to use Apache Beam
dataflow pipeline pipelines stream-processing
Last synced: 04 Oct 2025
https://github.com/gunnarmorling/streaming-examples
Example projects and demos around data streaming , stream processing, change data capture, and more.
change-data-capture data-engineering data-streaming stream-processing
Last synced: 28 Apr 2025
https://github.com/pauloeduardo1991/geo-ai-agent
🌍 Automate webpage content audits with GEO Agent Crew, extracting insights and optimization suggestions using cutting-edge AI tools for better online performance.
a2a-protocol agent agents chatgpt claude-code crewai gemma geo hackathon mcp mongodb multiagent-systems realtime seo serp-api stream-processing web-scraping yomo
Last synced: 13 Apr 2026
https://github.com/data-to-insight-center/cyberinfrastructure-knowledge-network
An Edge AI Distributed Framework
ai edge-computing kafka knowledge-graph neo4j python stream-processing
Last synced: 28 Apr 2025
https://github.com/ttulka/boundary-io-streams
Boundary I/O Streams Java Library
boundary boundary-stream input-output io java java-library stream stream-processing streaming
Last synced: 11 Mar 2025
https://github.com/lidatong/genstream
Method chaining comes to python
chaining generators method-chaining python stream stream-api stream-processing
Last synced: 25 Jun 2025
https://github.com/gvolpe/pricer-fs2-demo
Demo project using FS2 (Functional Streams for Scala)
Last synced: 02 Nov 2025
https://github.com/danthelion/twitter-trending
A small example visualizing live Twitter trending data using Redpanda and Materialize
kafka materialize metabase redpanda stream-processing
Last synced: 13 Mar 2026
https://github.com/cemayan/earthquake_collector
earthquakes eureka expo flink golang nodejs react-native stream-processing zuul
Last synced: 14 Apr 2026
https://github.com/mtumilowicz/scala-zio2-zstream-workshop
Introduction to streaming using zio (ZStream).
scala scala-zio stream-processing streaming workshop workshop-materials zio zio-effect zio-streams zio2
Last synced: 31 May 2026
https://github.com/v12technology/fluxtion
core fluxtion static event processor generator tool and runtime components
complex-event-processing event-processing event-sourcing event-streams java low-latency stream-processing stream-processor
Last synced: 14 Jan 2026
https://github.com/qiming-c/flink-wordcount
Flink Code Example
flink java kafka stream-processing
Last synced: 27 Apr 2026
https://github.com/hapag-lloyd/fluent-bit-multiline
Fast and Lightweight Logs and Metrics processor for Linux, BSD, OSX and Windows.
cloudnative data-collector fluent-bit fluentd forwarder logging logs metrics opentelemetry stream-processing traces
Last synced: 16 Jan 2026
https://github.com/ostafen/eventstorm
An EventStoreDB compatible database built on top of PostgreSQL.
eventsourcing eventstore eventstoredb postgresql projections projections-system stream-processing streams
Last synced: 09 May 2026
https://github.com/ibmstreams/streamsx.cybersecurity.starterapps
Starter applications for IBM Streams cybersecurity toolkit
cybersecurity ibm-streams network-analysis network-monitoring starter-applications starterkit stream-processing
Last synced: 12 Sep 2025
https://github.com/qntfy/frinesis
Frizzle for AWS Kinesis
aws golang golang-library kinesis message-bus pipeline producer stream-processing streaming-data
Last synced: 12 Jan 2026
https://github.com/ibmstreams/streamsx.elasticsearch
Toolkit to enable application developers to store streaming data into Elastic Search database
elasticsearch stream-processing toolkit
Last synced: 15 Jul 2025
https://github.com/ibmstreams/streamsx.nlp
Provide operations for text analysis, like lemmatization and text annotation with Uima Ruta scripts or existing project specific Uima pear files.
ibm-streams lemmatization natural-language-processing nlp nlp-machine-learning stream-processing text-analysis toolkit uima
Last synced: 15 Jul 2025
https://github.com/alansastre/java-functional-advanced
Programación funcional en Java. Procesamiento de datos con la API Stream en Java. Interfaz funcional Comparator.
collector comparator flatmap functional-programming java java-stream-api java11 java17 java8 reduce sorted stream-api stream-java stream-processing
Last synced: 20 Sep 2025
https://github.com/ibmstreams/streamsx.transportation
(Incubation) Toolkit for adaptors to access transit feeds as well as generic transportation based operators and functions
ibm-streams nextbus stream-processing transportation
Last synced: 15 Jul 2025
https://github.com/ibmstreams/streamsx.rabbitmq
Integrate IBM Streams with RabbitMQ
ibm-streams rabbitmq stream-processing toolkit
Last synced: 25 Jul 2025
https://github.com/zacernst/metalpipe
Modules for ETL Pipelines
data-ingestion etl stream-processing
Last synced: 03 Jan 2026
https://github.com/mgoblin/streaming_examples
flink flink-stream-processing stream-processing
Last synced: 14 Mar 2025
https://github.com/ibmstreams/streamsx.math
(Incubation) Mathematics and statistics toolkit.
ibm-streams mathematics stream-processing toolkit
Last synced: 11 Jul 2025
https://github.com/oresoftware/line-stream-parser
Node.js transform stream - reads buffered data, writes buffers representing lines split by newline
line-parser nodejs npm stream stream-processing
Last synced: 10 Apr 2026
https://github.com/rschlaefli/19fs-dspa-project
Semester project of Data Stream Processing and Analytics at ETHZ
flink kafka stream-analytics stream-processing
Last synced: 10 Jun 2026
https://github.com/wingedrhino/node-pipespawn
A utility to pipe a Readable through an external process and collect the output into a fresh Readable
nodejs pipes stream-processing
Last synced: 10 Mar 2026
https://github.com/ibmstreams/streamsx.avro
Toolkit to support serialization and deserialization in Avro format
avro avro-message ibm-streams stream-processing
Last synced: 30 Jun 2025
https://github.com/ibmstreams/sample.edge-rolling-average
Edge sample
edge-computing samples stream-processing
Last synced: 28 Jun 2025
https://github.com/ibmstreams/ibmstreams.github.io
Github Pages project for IBMStreams organization
Last synced: 02 Jan 2026
https://github.com/ibmstreams/streamsx.plumbing
Plumbing operators manipulate the flow of tuples in a Streams application, but are not part of the logic of the application
ibm-streams load-balancer performance stream-processing toolkit
Last synced: 15 Jul 2025
https://github.com/mtumilowicz/java-streams-laziness-needs-pure-functions
Why java streams laziness needs pure functions.
java-streams laziness pure-function stream stream-processing streams
Last synced: 01 Jul 2025
https://github.com/ibmstreams/streamsx.social
(Incubation) Toolkit for operators and functions to integrate Streams with social media sites.
ibm-streams social stream-processing toolkit twitter
Last synced: 15 Jul 2025
https://github.com/wrieg123/csp-adapter-zeromq
A CSP Adapter for the ZeroMQ Universal Messaging Library
cpp python stream-processing streaming zeromq
Last synced: 30 Apr 2026
https://github.com/ibmstreams/pypi.streamsx
Python core package for IBM Streams.
ibm-streams pypi python python-packages stream-processing
Last synced: 15 Jul 2025
https://github.com/ibm-cloud-architecture/refarch-eda-item-inventory
This project illustrates combining Kafka streams with reactive programming, reactive messaging with Quarkus. The use case is around getting item sold events and build a real time inventory in kafka streams exposed via REST on top of sequential queries.
eda kafka kafka-streams stream-processing
Last synced: 02 Jul 2025
https://github.com/denkhaus/nksh
Neo4j-Kafka-Stream-Handler
eventhandler kafka neo4j stream-processing
Last synced: 21 Apr 2026
https://github.com/lapetitesouris/sensormetrics
Apache Flink Aggregation job
apache-flink flink stream-processing
Last synced: 03 Apr 2025
https://github.com/gabrielrovesti/systemfx
Framework di stream processing in F# con garanzie formali per costruire pipeline di elaborazione dati robuste e componibili
formal-verification fsharp stream-processing
Last synced: 03 Mar 2025
https://github.com/ibmstreams/streamsx.tutorial.teda
Tutorials for TEDA
ibm-streams stream-processing tutorial
Last synced: 21 Feb 2026
https://github.com/rajnish93/jpandas
A lightweight JavaScript library for working with tabular data, inspired by Pandas in Python. Built with TypeScript, it provides an intuitive API for data manipulation and analysis.
data-analysis data-analytics data-manipulation data-science dataframe javascript pandas stream-processing table typescript
Last synced: 11 Jun 2025
