Projects in Awesome Lists tagged with stream-processing

https://github.com/kushal-bage/streaming-data-pipeline

📡 Build a robust streaming data pipeline using Docker, Kafka, Spark, and Cassandra for real-time ingestion, processing, and analytics.

dash data-mining data-science google-cloud-dataflow kafka lambda mongodb olap python spark sparta stream-processing streaming streaming-data topic-tracking triggers tweets twitter

Last synced: 04 May 2026

https://github.com/ibmstreams/streamsx.solr

(incubation) Integration with Apache Solr

ibm-streams lucenesearch solr solr-client solr-query stream-processing

Last synced: 17 Mar 2025

https://github.com/artyomturkin/go-stream

Common stream abstraction and in-memory implementation for streaming data

stream-processing streaming

Last synced: 12 Jan 2026

https://github.com/ibmstreams/streamsx.bytes

(Incubation) Functions to manipulate data and an operator to parse a message and extract bits from it based on a JSON definition

ibm-streams stream-processing

Last synced: 28 Oct 2025

https://github.com/denisogr/ucu-2018-func-stream-final-project-weather-provider

Weather provider for final project

kafka-streams ksql scala stream-processing

Last synced: 09 Jun 2026

https://github.com/hpgrahsl/rhd-blog-data-streaming-app-openshift

Repository for the Red Hat Developer Blog article "Stateful and reactive stream processing applications with Apache Kafka, Quarkus and Angular on OpenShift"

angular apache-kafka emojis kafka-streams kubernetes openshift quarkus reactive stream-processing

Last synced: 12 Apr 2025

https://github.com/vtramo/java-problems

Solutions for various types of medium-to-challenging level problems.

algorithm-challenges algorithms-and-data-structures completablefuture-api concurrent-programming declarative-programming exercises forkjoin functional-programming future java java-exercises lambda-functions parallel-programming problem-solving problems problemset solutions spliterator stream-processing thread-pool

Last synced: 11 Mar 2025

https://github.com/mpankajarun/stream-operations-with-rxjs

Fundamental functions on simple streams to practice RxJS and Stream Operations.

javascript observable-streams rxjs stream-processing

Last synced: 17 Jun 2026

https://github.com/thaitechtales/kafka

This repository serves as a collection of projects demonstrating expertise in Apache Kafka, a distributed event-streaming platform. The projects aim to highlight real-time data integration and stream processing solutions.

apache-kafka data-streaming distributed-systems event-driven kafka messaging real-time stream-processing

Last synced: 22 Feb 2026

https://github.com/apelullo/twitter_covid_stream_processing_ops

An AWS-based data pipeline to collect, process, store, and monitor Twitter streaming data thoughout the COVID-19 pandemic in support of local, regional, and national public health initiatives.

academic-research automation aws data-pipelines high-performance-computing multi-threaded-programming nlp operations operations-research public-health public-health-care public-health-insights python real-time-surveillance stream-processing text-mining topic-modeling tweepy twitter twitter-streaming-api

Last synced: 18 Apr 2026

https://github.com/amazingandyyy/go-grpc-start

gRPC in golang

golang grpc grpc-go http2 stream-processing

Last synced: 14 May 2026

https://github.com/yaricom/gostream

The simple data stream implementation using GO language based on the Redis stream

datastream golang stream-processing

Last synced: 24 Aug 2025

https://github.com/aymendaoudi/evcharging

Simulation, Ingestion and ETL-ing data of millions of EV charging sessions by thousands of EVs in thousands of stations around the world.

batch-processing data-engineering data-lake data-warehouse kafka kafka-connect lake-fs minio mongodb postgresql python3 simpy spark stream-processing

Last synced: 12 Mar 2025

https://github.com/ibmstreams/sample.edge-mnist-notebook

MNIST digit recognition notebook sample

edge-computing samples stream-processing

Last synced: 29 Jul 2025

https://github.com/andrewlowndes/multi_stream

Aggregate multiple streams of different types in a single stream with an item type that is a tuple of the incoming stream items.

event-driven-programming stream-processing

Last synced: 28 May 2026

https://github.com/julio-analyst/debezium-cdc-mirroring

cdc data-mirroring debezium kafka-connect postgresql real-time-replication stream-processing

Last synced: 30 Oct 2025

https://github.com/bernardini687/vm_translator

vm translator for nand2tetris (part 2)

nand2tetris nand2tetris-vm-translator stream-processing

Last synced: 12 Jun 2026

https://github.com/findcoo/s4

Simple Storage Service Stream

log s3 stream-processing

Last synced: 14 Jan 2026

https://github.com/ibmstreams/streamsx.transform

Toolkit that contains basic building block operators that efficiently transform data from one format to another

ibm-streams stream-processing toolkit

Last synced: 17 Mar 2025

https://github.com/micmurawski/cloud-array

cloud-array is an open-source Python library for storing and streaming large Numpy Arrays on local file systems and major cloud proviers CDNs.

aws azure big-data bigarray blob-storage cloud data-structures digitalocean-spaces gcp gcp-cloud-storage ibm-cloud-object-storage numpy s3 stream-processing streaming zadara

Last synced: 12 Aug 2025

https://github.com/bluebrown/iot-stream-analytics

mqtt & kafka based stream processing playground

emqx iot kafka mqtt stream stream-analysis stream-analytics stream-processing

Last synced: 18 May 2026

https://github.com/perfectlysoft/perfect-libkafka

Swift module imported from C library api `librdkafka`

kafka message-queue messaging messaging-library stream-processing streaming streaming-services

Last synced: 20 Sep 2025

https://github.com/cedrickchee/twit

A simple Twitter client

educational-project expressjs fullstack-javascript nodejs-api reactjs realtime stream-processing websocket

Last synced: 05 Apr 2026

https://github.com/agustinbettati/kafka-akka-streams

Simple playground for starting up a kafka broker with docker and using stream processing to consume and publish messages.

akka kafka stream-processing

Last synced: 12 Jun 2025

https://github.com/romiras/stream-throttler

A text line-based naive stream throttler that discards lines above predefined threshold rate.

ruby stream-processing

Last synced: 01 Apr 2025

https://github.com/mtumilowicz/java11-streams-laziness-needs-immutable-collections

Using mutable collections as source for streams may provoke cognitive breaks during processing.

immutability laziness stream stream-processing

Last synced: 23 Feb 2025

https://github.com/fpopic/avsp

(Class) Big Data Analysis Course Assignments

big-data bigdata message-passing pagerank-algorithm pcy simhash stream-processing

Last synced: 08 Jun 2026

https://github.com/im-a-kookie/cryptographic-aes-server

Simple manual implementation of multithreaded HTTP server via HTTPListenerContext, implementing custom AES virtual streams to provide large files securely.

aes-encryption cryptography http-server multithreaded-server stream-processing

Last synced: 11 Oct 2025

https://github.com/jepemo/basic-pipeline

Minimal & Simple Pipeline Engine for Python

pipeline python python3 stream-processing utility-function

Last synced: 05 Oct 2025

https://github.com/bearsunday/bear.streamer

A HTTP stream transfer

bearsunday-module beasunday stream-processing

Last synced: 19 Jul 2025

https://github.com/dinorain/depositaja

Depositaja - A fictitious service where user can deposit into their wallet and fetch their current balance using Event-driven architecture design using Apache Kafka.

apache-kafka concurrency event-driven go golang hacktoberfest kafka message-broker message-queue protobuf protocol-buffers stream-processing