https://github.com/skroutz/kafka-cluster-testbed

A Kafka cluster testbed for testing & development
https://github.com/skroutz/kafka-cluster-testbed

docker docker-compose kafka kafka-cluster zookeeper

Last synced: 2 months ago
JSON representation

A Kafka cluster testbed for testing & development

• Host: GitHub
• URL: https://github.com/skroutz/kafka-cluster-testbed
• Owner: skroutz
• Created: 2017-06-21T14:45:33.000Z (over 7 years ago)
• Default Branch: master
• Last Pushed: 2022-03-02T08:11:08.000Z (almost 3 years ago)
• Last Synced: 2023-03-22T14:27:20.140Z (almost 2 years ago)
• Topics: docker, docker-compose, kafka, kafka-cluster, zookeeper
• Language: Dockerfile
• Size: 20.5 KB
• Stars: 8
• Watchers: 7
• Forks: 2
• Open Issues: 1
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# Kafka Cluster Testbed

A Kafka cluster testbed for testing & development.

Services

--------

- Zookeeper (3 nodes)

- Kafka (2 nodes)

Dependencies

------------

- `docker.io`

- `docker-compose`

- `libnss-docker` (optional)

- `kafkacat` (optional, for testing)

Usage

-----

```shell

# Prepare cluster

$ docker-compose build

$ docker-compose up (Ctrl-C to stop)

# Create a new topic

$ docker-compose exec kc1.docker kafka-topics --zookeeper zoo1,zoo2 --topic top1 --partitions 2 --replication-factor 2 --create

top1

$ docker-compose exec kc1.docker kafka-topics --zookeeper zoo1,zoo2 --describe

Topic:top1	PartitionCount:2	ReplicationFactor:2	Configs:

	Topic: top1	Partition: 0	Leader: 1	Replicas: 1,2	Isr: 1,2

	Topic: top1	Partition: 1	Leader: 2	Replicas: 2,1	Isr: 2,1

# Pub/Sub

$ echo "Hello Kafka" | kafkacat -P -b kc1.docker -t top1

$ kafkacat -C -b kc1.docker -t top1 -c 1

Hello Kafka

# Rafka

$ redis-cli -p 6380 rpushx topics:top1 "hello there"

# Remove everything

$ docker-compose down

```