Data

Tools

Indexes

Applications

Experiments

Awesome

An open API service indexing awesome lists of open source software.

Projects in Awesome Lists tagged with flink-stream-processing

A curated list of projects in awesome lists tagged with flink-stream-processing .

https://github.com/getindata/flink-http-connector

Http Connector for Apache Flink. Provides sources and sinks for Datastream , Table and SQL APIs.

data-streaming flink flink-sql flink-stream-processing java

Last synced: 12 Jan 2026

https://github.com/decodableco/examples

🌟 Examples of use cases that utilize Decodable, as well as demos for related open-source projects such as Apache Flink, Debezium, and Postgres.

datamesh dataproducts etl flink flink-stream-processing kafka pyflink python stream-processing

Last synced: 09 Apr 2026

https://github.com/anant/cassandra.realtime

Different ways to process data into Cassandra in realtime with technologies such as Kafka, Spark, Akka, Flink

akka cassandra flink flink-stream-processing flink-streaming kafka kafka-connect spark spark-streaming

Last synced: 30 Jul 2025

https://github.com/Anant/Cassandra.Realtime

Different ways to process data into Cassandra in realtime with technologies such as Kafka, Spark, Akka, Flink

akka cassandra flink flink-stream-processing flink-streaming kafka kafka-connect spark spark-streaming

Last synced: 15 Apr 2025

https://github.com/sergio11/traffic_sentinel_architecture

🚀 Traffic Sentinel: A scalable IoT system using Fog nodes and Apache Flink to process 📷 IP camera streams, powered by YOLO for intelligent 🚗 traffic monitoring on highways. 🛣️

apache-nifi flask flink flink-stream-processing fog fog-computing iot-platform minio minio-server mongodb nifi nifi-processor redis tkinter ultralytics vault vehicle-detection vehicle-tracking yolo

Last synced: 13 Aug 2025

https://github.com/cjermain/flink-onnx-pytorch

Streaming machine learning using PyTorch, Flink, and ONNX

flink flink-stream-processing flink-streaming machine-learning onnx onnxruntime pytorch streaming

Last synced: 05 May 2025

https://github.com/aws-samples/amazon-kinesis-data-analytics-flink-benchmarking-utility

Amazon Managed Service for Apache Flink Benchmarking Utility helps with capacity planning, integration testing, and benchmarking of Amazon Managed Service for Apache Flink applications.

flink-stream-processing kinesis-data-analytics kinesis-streams

Last synced: 04 Apr 2025

https://github.com/brooksian/flink2kafka

A Flink applcation that demonstrates reading and writing to/from Apache Kafka with Apache Flink

flink-examples flink-kafka flink-stream-processing intellij-idea

Last synced: 12 Jun 2025

https://github.com/innogames/flink-real-time-crm

Demo Flink and Kafka project to show how to react on tracking events in real-time and trigger offer for customer engagement based on campaign configurations. The project also utilizes the Broadcast State Pattern in order to update the rules (campaigns) at runtime without restarting the project, using a dedicated, low-frequency, Kafka topic.

apacheflink apachekafka flink flink-examples flink-stream-processing flink-streaming java kafka stream-processing

Last synced: 18 Jun 2025

https://github.com/ev2900/flink_kinesis_data_analytics

Apache Flink examples designed to be run by AWS Kinesis Data Analytics (KDA).

aws flink flink-examples flink-sql flink-stream-processing flink-streaming flinksql kinesis

Last synced: 25 Aug 2025

https://github.com/riferrei/is-using-kop-a-good-idea

Is using KoP (Kafka-On-Pulsar) a good idea? Use the scenarios implemented in this repository to check whether Pulsar with KoP enabled is a good fit for your most common Kafka workloads.

apache flink-stream-processing kafka kafka-connect kafka-streams kop ksqldb microservices pulsar

Last synced: 30 Apr 2025

https://github.com/innogames/flink-real-time-crm-ui

Demo UI for the flink-real-time-crm project using Spring Boot with Thymeleaf. The Demo UI is able to send messages to and consume from the related Kafka topics.

apacheflink apachekafka flink flink-examples flink-stream-processing java kafka spring spring-boot thymeleaf

Last synced: 26 Jan 2026

https://github.com/e3oroush/flink-tutorial

A simple introduction to Apache/Flink CEP. Working with time window aggregation and simple match expression.

cep complex-event- flink flink-examples flink-stream-processing java

Last synced: 23 Mar 2025

https://github.com/yuhexiong/kafka-data-pipeline-structured-flink-java

Data pipeline from Kafka to Kafka, Doris and Doris to Kafka using Flink Java.

apache-doris apache-flink apache-kafka doris flink flink-stream-processing kafka

Last synced: 09 Feb 2026

https://github.com/nkonev/flink-pipe

A [single|uber|fat] jar standalone Apache Flink connected to PostgreSQL via Ververica CDC connector. Usage Flink SQL to replicate data from PostgreSQL to Elasticsearch/something else.

cdc debezium debezium-connector debezium-embedded elastic elasticsearch flink flink-cdc flink-sql flink-stream-processing flink-streaming postgres postgresql replication ververica-connector

Last synced: 25 Feb 2026

https://github.com/mgoblin/streams

Pet project to grow Apache Flink skills

flink flink-stream-processing

Last synced: 14 Mar 2025

https://github.com/datasystemsgrouput/disgd

A distributed shared-nothing variant of the incremental stochastic gradient descent algorithm

distributed-computing flink-stream-processing online-machine-learning recommender-systems

Last synced: 16 Jan 2026

https://github.com/SebastianSchmidl/FastFlinkStreams

A Flink demo project using Scala and SBT that analyzes HTTP log data from NASA.

flink flink-stream-processing sbt scala

Last synced: 21 Mar 2025

https://github.com/j3-signalroom/apache_flink-kickstarter

Examples of Apache Flink® applications showcasing the DataStream API and Table API in Java and Python, featuring AWS, GitHub, Terraform, and Apache Iceberg.

apache-flink apache-iceberg aws-glue aws-parameter-store aws-s3 aws-secrets-manager flink flink-examples flink-kafka flink-stream-processing github-actions iceberg snowflake streamlit-dashboard terraform-cloud

Last synced: 16 Mar 2025

https://github.com/sebastianschmidl/fastflinkstreams

A Flink demo project using Scala and SBT that analyzes HTTP log data from NASA.

flink flink-stream-processing sbt scala

Last synced: 23 May 2026

https://github.com/louisloechel/medical-data-stream-anonymization

"Anonymization of Medical Data Streams" Master's Thesis Demo

differential-privacy flink-stream-processing kafka medical-informatics

Last synced: 12 Jan 2026

https://github.com/sowrabh-m/data_processing_using_spark_flink

This project demonstrates data cleaning, processing with Apache Spark and Apache Flink, both locally and on AWS EMR.

aws aws-emr aws-s3 emr-cluster flink flink-stream-processing spark spark-flink spark-streaming

Last synced: 10 Mar 2026

https://github.com/gamussa/parkflow

Real-time parking management system with stream processing and analytics capabilities.

duckdb flink-stream-processing kafka kafka-streams python uv

Last synced: 10 May 2026

https://github.com/saeidshahriari/food-delivery-pipeline-latest

End-to-end data pipeline: PostgreSQL CDC (Debezium) → Kafka → Flink SQL → OpenSearch (search) + Redis (features). Local Docker stack, sample data, and verification scripts.

cdc data-engineering-pipeline debezium docker-composer flink-sql flink-stream-processing kafka kafka-connector opensearch-dashboards postgresql real-time-analytics redis

Last synced: 10 Oct 2025

https://github.com/suryadev99/stream_processing_website_click_data

Stream Processing of website click data using Kafka and monitored and visualised using Prometheus and Grafana

clickdata data dataengineering docker flink-kafka flink-metrics flink-stream-processing git grafana kafka kafka-streams kafka-topic prometheus psql python

Last synced: 10 Mar 2026

https://github.com/stefen-taime/real-time-extraction-transformation-and-exposure-architecture-for-rail-data

we are thrilled to announce our new PoC project aimed at providing a complete real-time extraction, transformation, and exposure architecture for the new provincial transportation systems.

api backend datacontract dataengineering elasticsearch flink-stream-processing frontend kafka kibana microservices nextjs python3 reactjs schemas software-engineering sql

Last synced: 11 Apr 2026

https://github.com/awakelife93/ktor-flink-pipeline

Modern streaming data pipeline built with Ktor, Kafka, and Apache Flink in Kotlin.

flink flink-stream-processing gradle kafka kotlin ktor pipeline streaming

Last synced: 16 Apr 2026

https://github.com/dyrnq/cdc-vagrant

CDC(Change Data Capture) is made up of two components, the CDD and the CDT. CDD is stand for Change Data Detection and CDT is stand for Change Data Transfer.

apache-doris cdc debezium etl flink flink-cdc flink-doris-connector flink-sql flink-stream-processing hadoop minio-cluster vagrantfile

Last synced: 18 Apr 2026

https://github.com/tashi-2004/apache-flink-spark-data-streaming

This project showcases a real-time data streaming pipeline using Apache Flink, Apache Spark, and Grafana. It streams data, stores it in Parquet format, and performs aggregations for insights, with seamless visualization via Grafana dashboards.

apache-flink apache-spark data-aggregation data-analysis data-science data-streaming data-visualization flink flink-stream-processing flink-streaming grafana-dashboard grafana-plugin pyflink python3

Last synced: 09 Feb 2026

https://github.com/librity/rtjvm_flink

Rock The JVM - Apache Flink with Scala

flink flink-sql flink-stream-processing rockthejvm rtjvm scala

Last synced: 12 Jun 2026

https://github.com/zablon-oigo/flinkcdc-elasticsearch-streaming-etl

This project demonstrates a real-time streaming ETL architecture that captures database changes from MySQL and PostgreSQL using CDC connectors, enriches the streams with Apache Flink SQL, and indexes the transformed data into Elasticsearch for low-latency search and analytics.

elasticsearch flink-cdc flink-sql flink-stream-processing github-actions kibana-dashboard mysql postgresql

Last synced: 23 Jun 2026

https://github.com/zablon-oigo/opensky-flink-trino-pipeline

This project demonstrates how to process millions of real-time aircraft events using Apache Flink

avro-schema docker-compose flink-stream-processing kafka opensky-api schema-registry superset trino

Last synced: 23 Jun 2026