https://github.com/pierrekieffer/docker-kafka-cluster
a Kafka multinode cluster deployed with docker-compose
https://github.com/pierrekieffer/docker-kafka-cluster
confluent confluent-kafka docker docker-compose kafka
Last synced: 2 months ago
JSON representation
a Kafka multinode cluster deployed with docker-compose
- Host: GitHub
- URL: https://github.com/pierrekieffer/docker-kafka-cluster
- Owner: PierreKieffer
- License: apache-2.0
- Created: 2019-06-24T10:02:56.000Z (almost 6 years ago)
- Default Branch: master
- Last Pushed: 2020-02-14T15:42:11.000Z (over 5 years ago)
- Last Synced: 2023-03-07T01:31:41.861Z (over 2 years ago)
- Topics: confluent, confluent-kafka, docker, docker-compose, kafka
- Language: Dockerfile
- Size: 28.3 KB
- Stars: 1
- Watchers: 0
- Forks: 2
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# docker-kafka-cluster
docker-kafka-ckuster allows to deploy a kafka multi node cluster (3 brokers, 1 zookeeper) with docker
https://medium.com/@PierreKieffer/deploy-a-kafka-multi-node-cluster-with-docker-72878ddbaf96
## Build the base image
- clone the repo
- `docker build -t kafka_base .`
## Launch the kafka cluster
- docker-compose up
## Test
### Run a client
- `docker run -it --network host kafka_base /bin/bash`
### Create a topic
- `./bin/kafka-topics --create --zookeeper localhost:2181 --replication-factor 3 --partitions 3 --topic topic_name`
### Run a console producer
- `./bin/kafka-console-producer --broker-list localhost:9091,localhost:9092,localhost:9093 --topic your_topic_name`
### Run a console consumer
- `./bin/kafka-console-consumer --topic your_topic_name --bootstrap-server localhost:9091,localhost:9092,localhost:9093`
### Monitoring consumer group
- `./bin/kafka-consumer-groups --describe --group groupId --bootstrap-server localhost:9091,localhost:9092,localhost:9093`