https://github.com/hhow09/go-kafka-example

kafka lab
https://github.com/hhow09/go-kafka-example

benchmark docker-compose golang kafka

Last synced: about 1 month ago
JSON representation

kafka lab

• Host: GitHub
• URL: https://github.com/hhow09/go-kafka-example
• Owner: hhow09
• Created: 2023-03-20T18:04:55.000Z (almost 2 years ago)
• Default Branch: master
• Last Pushed: 2023-03-24T03:41:22.000Z (almost 2 years ago)
• Last Synced: 2024-10-18T15:16:42.236Z (2 months ago)
• Topics: benchmark, docker-compose, golang, kafka
• Language: Go
• Homepage:
• Size: 129 KB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 2
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# Go Kafka Example

## Examples

### [basic](./basic/)

### [Basic Async Producer](./basic-async/)

- async producer

### [Basic Async Consumer Group (3)](./basic-async-consumer-group/)

- async producer with 3 consumers (same group)

### [Basic Batch Timeout Optimized](./basic-batchTimeout-optimized/)

- reduce batch timeout

### [replicated](./replicated/)

- adjust replication factor = 3

## How to use

- `make up`: run the services

- `up-rebuild`: run services with dockerfile rebuilt (if [producer](./producer/) or [consumer](./consumer/) need to rebuild)

- `make down`: stop services

### Settings

- change `REMOVE_RAW` to `false` if you want to see the raw logs of conumser

## Packages

- [producer](./producer/): message producer

- [consumer](./consumer/): message consumer (also write logs)

- [log-paresr](./log-paresr/): log paresr / analyzer for performance benchmark

## Ref

- [Kafka: The Definitive Guide v2](https://www.confluent.io/resources/kafka-the-definitive-guide-v2/)

- [conduktor/kafka-stack-docker-compose](https://github.com/conduktor/kafka-stack-docker-compose)

- [Implementing a Kafka Producer and Consumer In Golang (With Full Examples) For Production](https://www.sohamkamani.com/golang/working-with-kafka/)