https://github.com/soumyadip007/kafka-consumer-using-spring-boot-rest-and-microservices

A client that consumes records from a Kafka cluster. This client transparently handles the failure of Kafka brokers, and transparently adapts as topic partitions it fetches migrate within the cluster. This client also interacts with the broker to allow groups of consumers to load balance consumption using consumer groups. The consumer maintains TCP connections to the necessary brokers to fetch data. Failure to close the consumer after use will leak these connections. The consumer is not thread-safe. See Multi-threaded Processing for more details.
https://github.com/soumyadip007/kafka-consumer-using-spring-boot-rest-and-microservices

client consumer java kafka lombok mavek microservices rest springboot zookeeper

Last synced: about 1 month ago
JSON representation

A client that consumes records from a Kafka cluster. This client transparently handles the failure of Kafka brokers, and transparently adapts as topic partitions it fetches migrate within the cluster. This client also interacts with the broker to allow groups of consumers to load balance consumption using consumer groups. The consumer maintains TCP connections to the necessary brokers to fetch data. Failure to close the consumer after use will leak these connections. The consumer is not thread-safe. See Multi-threaded Processing for more details.

• Host: GitHub
• URL: https://github.com/soumyadip007/kafka-consumer-using-spring-boot-rest-and-microservices
• Owner: soumyadip007
• License: apache-2.0
• Created: 2020-05-24T14:06:51.000Z (over 4 years ago)
• Default Branch: master
• Last Pushed: 2020-05-26T06:20:45.000Z (over 4 years ago)
• Last Synced: 2024-11-09T23:37:11.289Z (3 months ago)
• Topics: client, consumer, java, kafka, lombok, mavek, microservices, rest, springboot, zookeeper
• Language: Java
• Homepage:
• Size: 71.3 KB
• Stars: 3
• Watchers: 2
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# Kafka-Consumer-using-Spring-Boot-Rest-and-Microservices

Apache Kafka is an open-source stream-processing software platform developed by LinkedIn and donated to the Apache Software Foundation, written in Scala and Java. The project aims to provide a unified, high-throughput, low-latency platform for handling real-time data feeds, Kafka works well as a replacement for a more traditional message broker.

This Project covers how to use Spring Boot with Spring Kafka to Consume JSON/String message from Kafka topics

## Start Zookeeper

- `bin/zookeeper-server-start.sh config/zookeeper.properties`

## Start Kafka Server

- `bin/kafka-server-start.sh config/server.properties`

## Create Kafka Topic

- `bin/kafka-topics.sh --create --zookeeper localhost:2181 --replication-factor 1 --partitions 1 --topic Kafka_Example`

- `bin/kafka-topics.sh --create --zookeeper localhost:2181 --replication-factor 1 --partitions 1 --topic Kafka_Example_json`

## Publish to the Kafka Topic via Console

- `bin/kafka-console-producer.sh --broker-list localhost:9092 --topic Kafka_Object`

- `bin/kafka-console-producer.sh --broker-list localhost:9092 --topic Kafka_String`