https://github.com/smallnest/kafka-example-in-scala
a kafka producer and consumer example in scala and java
https://github.com/smallnest/kafka-example-in-scala
Last synced: 28 days ago
JSON representation
a kafka producer and consumer example in scala and java
- Host: GitHub
- URL: https://github.com/smallnest/kafka-example-in-scala
- Owner: smallnest
- License: apache-2.0
- Created: 2015-03-13T06:15:33.000Z (about 10 years ago)
- Default Branch: master
- Last Pushed: 2017-01-12T10:29:33.000Z (over 8 years ago)
- Last Synced: 2025-03-19T06:49:10.508Z (about 1 month ago)
- Language: Java
- Size: 19.5 KB
- Stars: 153
- Watchers: 14
- Forks: 134
- Open Issues: 2
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
[](https://drone.io/github.com/smallnest/kafka-example-in-scala/latest)
kafka producer and consumer example in scala and java
you can test with local server.
### start zookeeper
if you have installed zookeeper, start it, or
run the command:
``` sh
bin/zookeeper-server-start.sh config/zookeeper.properties
```
### start kafka with default configuration
``` sh
> bin/kafka-server-start.sh config/server.properties
```
### create a topic
``` sh
> bin/kafka-topics.sh --create --zookeeper localhost:2181 --replication-factor 1 --partitions 10 --topic test_topic
```
### package this example
``` sh
mvn clean package
```
it will package compiled classes and its dependencies into a jar.
### Run the Producer
This example also contains two producers written in Java and in scala.
you can run this for java:
``` sh
java -cp kafka_example-0.1.0-SNAPSHOT.jar com.colobu.kafka.ProducerExample 10000 test_topic localhost:9092
```
or this for scala
``` sh
java -cp kafka_example-0.1.0-SNAPSHOT.jar com.colobu.kafka.ScalaProducerExample 10000 test_topic localhost:9092
```
### Run the Consumer
This example contains two consumers written in Java and in scala.
You can run this for java:
``` sh
java -cp kafka_example-0.1.0-SNAPSHOT.jar com.colobu.kafka.ConsumerExample localhost:9092 group1 test_topic 10 0
```
or this for scala:
``` sh
java -cp kafka_example-0.1.0-SNAPSHOT.jar com.colobu.kafka.ScalaConsumerExample localhost:9092 group1 test_topic 10 0
```