Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

Projects in Awesome Lists tagged with kafka-producer

A curated list of projects in awesome lists tagged with kafka-producer .

https://github.com/mukul273/springboot-kafka

Sprint boot with Apache kafka integration - Consumer and Producer

apache-kafka kafka kafka-consumer kafka-producer spring-boot

Last synced: 24 Dec 2024

https://github.com/renatoelho/nifi-kafka-integracao

Vou mostrar como realizar a integração entre o Apache Nifi e o Apache Kafka de maneira simples e eficiente. Ao combinar essas duas poderosas ferramentas, é possível otimizar o fluxo de dados entre sistemas de forma escalável e sem complicações.

control-center docker docker-compose kafka kafka-consumer kafka-producer nifi zookeeper

Last synced: 25 Nov 2024

https://github.com/khalefahmed/kafka_twitter

A pipeline which ingest data from twitter in real time and sink them into ElasticSearch

kafka kafka-consumer kafka-producer kafka-streams sl4j

Last synced: 28 Dec 2024

https://github.com/shkvik/nestjs-kafka-producer

This is a NestJS application developed as a producer for Apache Kafka. It provides a simple and efficient interface for sending messages in the Kafka topic, supporting asynchronous operations and flexible configuration of the microservice architecture.

broker kafka-producer nestjs

Last synced: 31 Oct 2024

https://github.com/jonathanmdr/spot

Spring Cloud Stream example with Java functional programming and Kafka

gradle java-17 kafka kafka-consumer kafka-producer kafka-streams spring-boot spring-cloud spring-cloud-stream springboot3-x

Last synced: 31 Oct 2024

https://github.com/josephc45/typeahead_application

The Typeahead Application is a scalable and efficient system that provides real-time suggestions as users type.

docker hdfs java jenkins junit kafka-producer microservice mockito python spark spring-boot websockets

Last synced: 20 Dec 2024

https://github.com/grntlrduck-cloud/go-kafka-sample

A very basic sample application with a Kafka consumer and a producer.

go kafka kafka-consumer kafka-producer testcontainers-go

Last synced: 05 Jan 2025

https://github.com/atd-schubert/legman-kafka

Kafka Consumer and Producer for Legman streams

kafka kafka-consumer kafka-producer nodejs stream

Last synced: 25 Dec 2024

https://github.com/stylepatrick/spring-boot-kafka-demo

Demo with Kafka producer and cosumer in Spring Boot. Convert messages from POJOs to JSON and vice versa.

kafka kafka-consumer kafka-producer spring-boot webmvc

Last synced: 27 Nov 2024

https://github.com/chinmayvivek/rust-kafka

This project demonstrates a simple integration of Apache Kafka with Rust using the rdkafka crate. It includes basic examples of how to create a Kafka consumer and producer, showcasing how to send and receive messages.

docker docker-compose kafka kafka-consumer kafka-producer rust rust-lang

Last synced: 15 Dec 2024

https://github.com/sufiyan33/kafka-go

Connecting Apache Kafka with Golang. here, I am demonstrating that how to produce & consume messages. I also created config, topic, partitions.

apache-kafka go golang kafka kafka-consumer kafka-go kafka-go-examples kafka-producer

Last synced: 02 Dec 2024

https://github.com/ferama/bruco

🐛 Easy build streaming pipelines. Handle business logic in python

golang kafka kafka-consumer kafka-producer pipeline python yaml

Last synced: 24 Oct 2024

https://github.com/hieuung/streaming-kafka

Using various data processing tool for real time data pipeline with Kafka

apache-beam apache-flink apache-spark kafka kafka-consumer kafka-producer spark-streaming spark-streaming-kafka

Last synced: 17 Jan 2025

https://github.com/renatospaka/fc2.0-imersao2-banking-api

Features an API to interact with PIX server

grpc kafka-consumer kafka-producer nestjs postgres

Last synced: 05 Jan 2025

https://github.com/sowrabh-m/data-ingestion-with-kafka-and-nifi

This project demonstrates the integration of Apache Kafka, Apache NiFi, and a Python producer/consumer using confluent_kafka.

apache apache-kafka apache-nifi kafka kafka-consumer kafka-producer

Last synced: 04 Dec 2024

https://github.com/senssei/azure-eventhub-kafka-c

Sample C/C++ consumer and producer implementation for Azure EventHub with Kafka surface

azure-eventhub c cpp kafka kafka-consumer kafka-producer librdkafka

Last synced: 09 Dec 2024

https://github.com/fhussonnois/aiven-kafka-micronaut-iot-demo

Using Aiven Kafka with Micronaut Framework

aiven kafka kafka-producer micronaut

Last synced: 16 Dec 2024

https://github.com/hackerharsh-77/kafka-message-service

Created a Kafka Message service which takes Delivery rider's info such as Rider location and transfers the data to multiple consumer groups with high throughput

docker docker-image kafka kafka-consumer kafka-producer nodejs zookeeper

Last synced: 23 Dec 2024

https://github.com/thearyanahmed/ts-boilerplate

This is a boilerplate for using kafka. Serves RESTful apis with logging, support for configuration and .env, error handling and testsuite.

kafka kafka-consumer kafka-producer logging node testing typescript

Last synced: 03 Jan 2025

https://github.com/j3-signalroom/j3-kafka-tips_and_tricks

Essential Kafka Tips & Tricks for Optimized Performance and Reliability.

kafka kafka-consumer kafka-producer

Last synced: 11 Dec 2024

https://github.com/kelbudiul/kafka-producer

A Kafka producer application for simulating streaming event. It supports single and batch message sending modes, making it suitable for testing and development scenarios in streaming apps.

dev-environment-setup kafka kafka-producer

Last synced: 12 Dec 2024

https://github.com/opt-nc/atelier-spring-kafka

Projet d'exemple d'utilisation de la lib `org.springframework.kafka:spring-kafka`

digital-le elearning glia kafka kafka-client kafka-consumer kafka-producer kafka-streams learning-by-doing tutorial

Last synced: 12 Dec 2024

https://github.com/bunu23/spring-kafka-basic

This repo contains a simple demo of integrating Apache Kafka with Spring Boot..

kafka kafka-consumer kafka-producer spring-boot

Last synced: 23 Nov 2024

https://github.com/wlanboy/gokafkaclient

golang command line kafka client

golang kafka-consumer kafka-producer ticker-scheduling

Last synced: 19 Dec 2024

https://github.com/recker-dev/kafka-quixstream_using_wsl

This project demonstrates a real-time data streaming pipeline using Windows Subsystem for Linux (WSL), Apache Kafka, and Quixstreams. The pipeline generates fake data using Faker, streams it through Kafka, and consumes it in real-time using Quixstreams.

kafka kafka-consumer kafka-producer python quixstream ubuntu wsl2

Last synced: 13 Dec 2024

https://github.com/byhbt/phoenix-kafka-sample

Sample Phoenix Application produce message to Kafka

kafka-producer phoenix-framework

Last synced: 19 Nov 2024

https://github.com/fr33m0nk/kafka-cluster-test-utility

A Clojure library designed to simplify the execution of end-to-end tests for applications that use Kafka as message broker or streaming platform.

clojure embedded-kafka embedded-kafka-cluster end-to-end-testing kafka kafka-cluster kafka-consumer kafka-producer kafka-streams

Last synced: 10 Nov 2024

https://github.com/goyalyatin/kafka-apis

Exploring various apis of kafka and creating new ones for some use cases

java kafka kafka-connect kafka-consumer kafka-producer kafka-streams

Last synced: 03 Jan 2025

https://github.com/blankscreen-exe/kafka-docker-deadletterqueue

This is a Pumpjack Data Works internship task where we have to setup a system which will keep the data stream from getting lost before going into the Kafka Broker and alert the producer to resend that specific data packet. All things networking included.

deadletter deadletter-queue kafka kafka-consumer kafka-producer python3

Last synced: 08 Jan 2025

https://github.com/bm777/predictive-maintenance

Predictive maintenance using ML, hosted by FastAPI and Kafka

anomaly-detection api-rest fastapi kafka-consumer kafka-producer predictive-maintenance

Last synced: 05 Jan 2025

https://github.com/muthukumar89uk/go-simple-kafka-example

It is a simple data streaming application implemented by Golang and Kafka. The producer can produce the data using the topics and the consumer can consume the data using the same topic.

go golang kafka kafka-consumer kafka-producer

Last synced: 15 Dec 2024

https://github.com/krishnalagad/kafka-message-broker-projects

This repository contains microservices that uses kafka message broker to communicate with each other.

kafka kafka-consumer kafka-producer microservices

Last synced: 19 Nov 2024

https://github.com/ankitrajput0096/kafka_zookeeper_springboot_producers_consumers

This project sets up a Dockerized Apache Kafka cluster with three Kafka servers monitored by a three-node Zookeeper ensemble, ensuring high availability and fault tolerance. It also includes three Spring Boot-based producer and consumer applications, demonstrating seamless integration and message processing within the Kafka ecosystem.

docker docker-compose kafka kafka-cluster kafka-consumer kafka-producer spring-boot zookeeper

Last synced: 08 Jan 2025

https://github.com/nabeel-ahmed-jamil/velocity

Email Sending With Velocity Template and Part of (F-Server for G-zip Compression for images and files transfer) ===> Done

email gson gzip-compression java-8 kafka-consumer kafka-producer kafka-topic log4j2 mockito mongodb spring-boot swagger2 velocity velocity-template

Last synced: 29 Dec 2024

https://github.com/devtonin/kafka-java-poc

A PoC app built-in Java with Spring Boot to study Apache Kafka.

java kafka kafka-consumer kafka-producer

Last synced: 30 Dec 2024

https://github.com/devtonin/kafka-kotlin-poc

A PoC app built-in Kotlin with Spring Boot to study Apache Kafka.

kafka kafka-consumer kafka-producer kotlin

Last synced: 30 Dec 2024

https://github.com/imrafaelmerino/kafka-cli

Kafka CLI is a user-friendly command-line interface designed to simplify and optimize your interaction with Apache Kafka, a distributed platform for building real-time data pipelines and streaming applications. Managing Kafka producers, consumers, and message publishing can be complex, but Kafka CLI streamlines these tasks with its intuitive CLI

cli generator kafka kafka-consumer kafka-producer

Last synced: 08 Jan 2025

https://github.com/hpgrahsl/kafka-azure-gab2017

Code samples for my Apache Kafka on Azure HDInsight talk at Global Azure Bootcamp 2017

azure hdinsight java kafka kafka-producer kafka-streams

Last synced: 08 Jan 2025

https://github.com/hauptmedia/docker-zeebe-with-exporters

Docker image for Zeebe integrated with the Kafka and Hazelcast Exporter Plugin

hazelcast kafka kafka-producer zeebe zeebe-exporter

Last synced: 10 Jan 2025

https://github.com/pavdmyt/pagemonitor

Collects website availability metrics and sends them into Kafka

async kafka-producer monitoring python

Last synced: 27 Dec 2024

https://github.com/dianper/kafka-producer-consumer

A basic sample of how to create a producer and consumer in Kafka using Intellij.

apache-kafka intellij java kafka-consumer kafka-producer

Last synced: 30 Dec 2024

https://github.com/hellomaxime/java-kafka

java kafka producer and consumer

kafka kafka-consumer kafka-producer

Last synced: 28 Dec 2024

https://github.com/phelipe-sempreboni/kafka

Repository for tutorials, information and notes about apache kafka, for installation, commands, topic checks, messaging, consumer, producer, and other topics.

apache-kafka kafka kafka-consumer kafka-producer kafka-streams kafka-topic

Last synced: 01 Jan 2025

https://github.com/imdesai00/kafka-producer-consumer

in this project i can send json data as producer to kafka and as consumer consume that json data and show that data to user

api csharp dotnetcore dotnetcorewebapi kafka kafka-consumer kafka-producer

Last synced: 19 Nov 2024