https://github.com/rishabh96b/kafka-perf-test
Kafka performance testing tool to test your Kubernetes, DC/OS, and On-Prem/Local Kafka Clusters.
https://github.com/rishabh96b/kafka-perf-test
confluent-kafka docker hacktoberfest kafka kafka-cluster kafka-performance-tester kubernetes performance-testing test-runner
Last synced: 10 days ago
JSON representation
Kafka performance testing tool to test your Kubernetes, DC/OS, and On-Prem/Local Kafka Clusters.
- Host: GitHub
- URL: https://github.com/rishabh96b/kafka-perf-test
- Owner: rishabh96b
- Created: 2020-09-24T17:19:15.000Z (over 4 years ago)
- Default Branch: master
- Last Pushed: 2020-10-07T03:17:24.000Z (over 4 years ago)
- Last Synced: 2025-03-27T13:01:41.388Z (27 days ago)
- Topics: confluent-kafka, docker, hacktoberfest, kafka, kafka-cluster, kafka-performance-tester, kubernetes, performance-testing, test-runner
- Language: Dockerfile
- Homepage:
- Size: 20.5 KB
- Stars: 8
- Watchers: 2
- Forks: 7
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# Kafka Performance Tester
[](https://circleci.com/gh/rishabh96b/kafka-perf-test)
### Introduction ###
Kafka Performance Tester is a tool to load test your Kafka cluster. It uses Apache Kafka's inbuilt `kafka-producer-perf-test.sh` and `kafka-consumer-perf-test.sh` utilities and additional tools to make the test suit ready to roll.
### Requirements ###
- Docker
- A running Kafka cluster(With one or multiple brokers)
### Supported Platforms ###
Kafka Performance Tester can be used on any platform, thanks to Docker! Currently the standard configuration is created for DC/OS only which resides in `options.json`. In coming days, a standard deployable config for Kubernetes will also be added.
### Quick Start ###
Set the necessary environment variables.
- For DC/OS, set the parameters in `options.json`.
- For Kubernetes, use `deployment.yaml`
- For local system, set the vars manually inside the docker container using:
- ```bash
docker run -it rishabh96b/kafka-workload:latest bash
export NUM_TOPICS=30
export NUM_RECORDS=1024
export RECORD_SIZE=50
export PRODUCER_THROUGHPUT=10
export TEST_INTERVAL_SECONDS=5
export BOOTSTRAP_SERVERS="http://localhost:9092"
```
To run Producer benchmarks:
```bash
./producer_test.sh
```
To run Consumer benchmarks:
```bash
./consumer_test.sh
```