https://github.com/ivangfr/spring-cloud-stream-kafka-multi-topics
The goal of this project is to create two applications: one as a Spring Boot producer and the other as a Spring Boot consumer. We'll be using Spring for Apache Kafka and Spring Cloud Stream.
https://github.com/ivangfr/spring-cloud-stream-kafka-multi-topics
docker java jib kafdrop kafka spring-boot spring-cloud-stream spring-kafka spring-webflux
Last synced: 3 months ago
JSON representation
The goal of this project is to create two applications: one as a Spring Boot producer and the other as a Spring Boot consumer. We'll be using Spring for Apache Kafka and Spring Cloud Stream.
- Host: GitHub
- URL: https://github.com/ivangfr/spring-cloud-stream-kafka-multi-topics
- Owner: ivangfr
- Created: 2019-09-11T07:49:58.000Z (almost 6 years ago)
- Default Branch: master
- Last Pushed: 2024-12-16T18:35:06.000Z (7 months ago)
- Last Synced: 2025-03-24T08:42:33.674Z (4 months ago)
- Topics: docker, java, jib, kafdrop, kafka, spring-boot, spring-cloud-stream, spring-kafka, spring-webflux
- Language: Java
- Homepage:
- Size: 1.3 MB
- Stars: 10
- Watchers: 2
- Forks: 9
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- Funding: .github/FUNDING.yml
Awesome Lists containing this project
README
# spring-cloud-stream-kafka-multi-topics
The goal of this project is to create two applications: one as a [`Spring Boot`](https://docs.spring.io/spring-boot/index.html) producer and the other as a `Spring Boot` consumer. We'll be using [`Spring for Apache Kafka`](https://docs.spring.io/spring-kafka/reference/index.html) and [`Spring Cloud Stream`](https://docs.spring.io/spring-cloud-stream/reference/).
Similar projects are: [`spring-kafka-de-serialization-types`](https://github.com/ivangfr/spring-kafka-de-serialization-types) and [`spring-cloud-stream-kafka-elasticsearch`](https://github.com/ivangfr/spring-cloud-stream-kafka-elasticsearch).
## Proof-of-Concepts & Articles
On [ivangfr.github.io](https://ivangfr.github.io), I have compiled my Proof-of-Concepts (PoCs) and articles. You can easily search for the technology you are interested in by using the filter. Who knows, perhaps I have already implemented a PoC or written an article about what you are looking for.
## Additional Readings
- \[**Medium**\] [**Implementing a Kafka Producer and Consumer using Spring Cloud Stream**](https://medium.com/@ivangfr/implementing-a-kafka-producer-and-consumer-using-spring-cloud-stream-d4b9a6a9eab1)
- \[**Medium**\] [**Implementing Unit Tests for a Kafka Producer and Consumer that uses Spring Cloud Stream**](https://medium.com/@ivangfr/implementing-unit-tests-for-a-kafka-producer-and-consumer-that-uses-spring-cloud-stream-f7a98a89fcf2)
- \[**Medium**\] [**Implementing End-to-End testing for a Kafka Producer and Consumer that uses Spring Cloud Stream**](https://medium.com/@ivangfr/implementing-end-to-end-testing-for-a-kafka-producer-and-consumer-that-uses-spring-cloud-stream-fbf5e666899e)
- \[**Medium**\] [**Configuring Distributed Tracing with Zipkin in a Kafka Producer and Consumer that uses Spring Cloud Stream**](https://medium.com/@ivangfr/configuring-distributed-tracing-with-zipkin-in-a-kafka-producer-and-consumer-that-uses-spring-cloud-9f1e55468b9e)
- \[**Medium**\] [**Using Cloudevents in a Kafka Producer and Consumer that uses Spring Cloud Stream**](https://medium.com/@ivangfr/using-cloudevents-in-a-kafka-producer-and-consumer-that-uses-spring-cloud-stream-9c51670b5566)
- \[**Medium**\] [**Running in Minikube (Kubernetes) a Kafka Producer and Consumer that uses Spring Cloud Stream**](https://medium.com/@ivangfr/running-in-minikube-kubernetes-a-kafka-producer-and-consumer-that-uses-spring-cloud-stream-d50b2dbfc5ea)
## Examples
- ### [spring-kafka](https://github.com/ivangfr/spring-cloud-stream-kafka-multi-topics/tree/master/spring-kafka#spring-cloud-stream-kafka-multi-topics)
- ### [spring-cloud-stream](https://github.com/ivangfr/spring-cloud-stream-kafka-multi-topics/tree/master/spring-cloud-stream#spring-cloud-stream-kafka-multi-topics)
## Prerequisites
- [`Java 21+`](https://www.oracle.com/java/technologies/downloads/#java21)
- Some containerization tool [`Docker`](https://www.docker.com), [`Podman`](https://podman.io), etc.
## Start Environment
- Open a terminal and inside the `spring-cloud-stream-kafka-multi-topics` root folder run:
```
docker compose up -d
```
- Wait for Docker containers to be up and running. To check it, run:
```
docker ps -a
```
- Create the Kafka topics used by the applications:
```
./create-kafka-topics.sh
```
## Useful Links
- **Kafdrop**
`Kafdrop` can be accessed at http://localhost:9000
## Shutdown
To stop and remove docker compose containers, network and volumes, in a terminal, navigate to the `spring-cloud-stream-kafka-multi-topics`, run the command below:
```
docker compose down -v
```
## Cleanup
To remove the Docker images created by this project, in a terminal and inside the `spring-cloud-stream-kafka-multi-topics` root folder, run the following script:
```
./remove-docker-images.sh
```