https://github.com/gotocva/apache-kafka
Let's build a pub/sub program using Kafka and Node.js, Kafka is a enterprise level tool for sending messages across the Microservices.
https://github.com/gotocva/apache-kafka
Last synced: over 1 year ago
JSON representation
Let's build a pub/sub program using Kafka and Node.js, Kafka is a enterprise level tool for sending messages across the Microservices.
- Host: GitHub
- URL: https://github.com/gotocva/apache-kafka
- Owner: gotocva
- License: mit
- Created: 2020-01-24T08:00:23.000Z (over 6 years ago)
- Default Branch: master
- Last Pushed: 2020-01-24T10:55:44.000Z (over 6 years ago)
- Last Synced: 2025-01-18T11:29:14.242Z (over 1 year ago)
- Language: JavaScript
- Size: 13.7 KB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 1
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
Prerequisites
Kafka is written in Java, so it requires a JVM;
OpenJDK 8 must be installed on your server.
To install OpenJDK 8, execute the following command:
```
$ sudo apt install openjdk-8-jdk
```
Verify that this is installed with
```
$ java -version
```
Install apache kafka
```
$ sudo useradd kafka -m
```
```
$ sudo passwd kafka
```
It asks for new password for user kafka
```
$ sudo adduser kafka sudo
```
```
$ su -l kafka
```
To start, create a directory in /home/kafka called Downloads to store your downloads:
```
$ mkdir ~/Downloads
```
```
$ curl "https://www.apache.org/dist/kafka/2.1.1/kafka_2.11-2.1.1.tgz" -o ~/Downloads/kafka.tgz
```
```
$ mkdir ~/kafka && cd ~/kafka
```
```
$ tar -xvzf ~/Downloads/kafka.tgz --strip 1
```
Configuring kafka server
```
$ nano ~/kafka/config/server.properties
```
Let’s add a setting that will allow us to delete Kafka topics. Add the following to the bottom of the file:
~/kafka/config/server.properties
delete.topic.enable = true
```
$ sudo nano /etc/systemd/system/zookeeper.service
```
[Unit]
Requires=network.target remote-fs.target
After=network.target remote-fs.target
[Service]
Type=simple
User=kafka
ExecStart=/home/kafka/kafka/bin/zookeeper-server-start.sh /home/kafka/kafka/config/zookeeper.properties
ExecStop=/home/kafka/kafka/bin/zookeeper-server-stop.sh
Restart=on-abnormal
[Install]
WantedBy=multi-user.target
```
$ sudo nano /etc/systemd/system/kafka.service
```
```
$ sudo systemctl start kafka
```
To ensure that the server has started successfully, check the journal logs for the kafka unit:
```
$ sudo journalctl -u kafka
```
You should see output similar to the following:
Output
Jul 17 18:38:59 kafka-ubuntu systemd[1]: Started kafka.service.
You now have a Kafka server listening on port 9092.
While we have started the kafka service, if we were to reboot our server, it would not be started automatically. To enable kafka on server boot, run:
```
$ sudo systemctl enable kafka
```