https://github.com/jrzaurin/ml-pipeline

Using Kafka-Python to illustrate a ML production pipeline

hyperopt hyperparameter-optimization kafka-python lightgbm machine-learning mlflow

Last synced: 14 Apr 2025

https://github.com/nserban/zabbix-kafka-consumers-monitor

Monitor Kafka Consumer groups (consumers and lag) in Zabbix

kafka kafka-consumer kafka-monitor kafka-python monitoring zabbix zabbix-templates

Last synced: 26 Oct 2025

https://github.com/dheerajcl/distributed_logging_system

apache-kafka distributed-computing elasticsearch elasticsearch-plugin elasticsearch-queries fluentd fluentd-logger fluentd-plugin kafka-plugins kafka-python kibana-visualization logging pub-sub-system

Last synced: 11 Apr 2025

https://github.com/san089/sf-crime-statistics

A Kafka and Spark Streaming Integration project : SF Crime Statistics with Spark Streaming

kafka kafka-consumer kafka-producer kafka-python spark-sql spark-streaming

Last synced: 19 Jun 2025

https://github.com/debanjansarkar/pyspark-maestro

This repo contains implementations of PySpark for real-world use cases for batch data processing, streaming data processing sourced from Kafka, sockets, etc., spark optimizations, business specific bigdata processing scenario solutions, and machine learning use cases.

json kafka kafka-python kafka-streams pyspark pyspark-api pyspark-machine-learning pyspark-mllib pyspark-streaming python3 spark spark-mllib spark-sql spark-streaming

Last synced: 04 Feb 2026

https://github.com/graphtylove/kafka-python-demo

Small example on how to use Kafka with python and docker.

docker docker-compose kafka kafka-python python queue

Last synced: 12 Sep 2025

https://github.com/abhimanyuhk/kafka-python

kafka kafka-consumer kafka-producer kafka-programming kafka-python python

Last synced: 23 Feb 2025

https://github.com/dumbremadhura/apache-kafka-city-bike-project

Real-time data pipeline using Apache Kafka and Python to stream Citi Bike NYC station data. Demonstrates producing and consuming messages via Kafka, containerized with Docker. Built as part of a hands-on Kafka learning project.

citibikenyc data-streaming docker gbfs kafka kafka-python real-time

Last synced: 01 Jul 2025

https://github.com/quantumbagel/dronetracker

A drone-following script for NC State's AERPAW drones.

axis-camera internship-project kafka-python onvif python python3 recording trigonometry vapix

Last synced: 12 Jul 2025

https://github.com/anshumanpattnaik/kafka-manager

A Python library for managing Kafka Producers, Consumers and Topics

kafka kafka-manager kafka-python python

Last synced: 15 Jun 2025

https://github.com/joshuamhtsang/zookeeper_kafka_example_setup

An example methodology for setting up a Kafka and Zookeeper system

docker-compose kafka-python

Last synced: 18 Mar 2025

https://github.com/shiningflash/kafka-python-messaging-engine

A Python-based Kafka messaging engine with Avro serialization, Schema Registry integration, and Redpanda support for real-time data streaming.

avro confluent-kafka data-pipeline data-streaming event-driven event-driven-architecture kafka kafka-python python real-time-data real-time-messaging redpanda schema-registry

Last synced: 25 Dec 2025

https://github.com/juliocesarscheidt/oci-streams

kafka kafka-python oracle terraform

Last synced: 18 Mar 2025

https://github.com/joshuamhtsang/kafka_example

An excuse to play around with Kafka and starting clusters of Zookeepers and Kafka Brokers using Docker Compose.

kafka kafka-python

Last synced: 03 Jan 2026