https://github.com/gkhays/kafka-poc
Produce and consume Kafka messages
https://github.com/gkhays/kafka-poc
docker docker-compose java kafka
Last synced: about 2 months ago
JSON representation
Produce and consume Kafka messages
- Host: GitHub
- URL: https://github.com/gkhays/kafka-poc
- Owner: gkhays
- License: apache-2.0
- Created: 2020-01-29T20:20:07.000Z (over 6 years ago)
- Default Branch: master
- Last Pushed: 2023-09-05T22:01:43.000Z (almost 3 years ago)
- Last Synced: 2026-04-22T18:46:44.791Z (2 months ago)
- Topics: docker, docker-compose, java, kafka
- Language: Java
- Size: 20.5 KB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 1
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# kafka-poc
Produce and consume Kafka messages
## Testing
There is a live version of the `fast-data-dev` image at the following location:
https://fast-data-dev.demo.landoop.com/
The organization has changed its name from Landoop to LensesIO. The image is here:
https://github.com/lensesio/fast-data-dev
### Docker
```
$ docker-compose up -d
Creating network "kafka-poc_default" with the default driver
Creating kafka-poc_broker_1 ... done
```
```
$ docker-compose down
Stopping kafka-poc_broker_1 ... done
Removing kafka-poc_broker_1 ... done
Removing network kafka-poc_default
```
### Coyote Tests
http://localhost:3030/coyote-tests/
```
$ curl -vs --stderr - "http://localhost:8082/topics"
* Trying ::1...
* TCP_NODELAY set
* Connected to localhost (::1) port 8082 (#0)
> GET /topics HTTP/1.1
> Host: localhost:8082
> User-Agent: curl/7.63.0
> Accept: */*
>
< HTTP/1.1 200 OK
< Date: Wed, 29 Jan 2020 18:20:36 GMT
< Content-Type: application/vnd.kafka.v1+json
< Vary: Accept-Encoding, User-Agent
< Content-Length: 260
< Server: Jetty(9.4.14.v20181114)
<
["_schemas","backblaze_smart","connect-configs","connect-offsets","connect-statuses","coyote-test-avro","coyote-test-binary","coyote-test-json","logs_broker","nyc_yellow_taxi_trip_data","sea_vessel_position_reports","telecom_italia_data","telecom_italia_grid"]* Connection #0 to host localhost left intact
```
### Command Line Utilities
Create a topic.
```
kafka-topics --create --zookeeper localhost:2181 --replication-factor 1 --partitions 1 --topic test
```
Write some messages to the topic.
```
kafka-console-producer --broker-list localhost:9092 --topic test
```
## References
1. [Getting started with kafka](https://success.docker.com/article/getting-started-with-kafka)