https://github.com/sai3010/kafka-fluentd-docker
Dockerised Fluentd pushing logs to an Apache Kafka topic
https://github.com/sai3010/kafka-fluentd-docker
Last synced: 11 months ago
JSON representation
Dockerised Fluentd pushing logs to an Apache Kafka topic
- Host: GitHub
- URL: https://github.com/sai3010/kafka-fluentd-docker
- Owner: sai3010
- Created: 2020-06-30T07:30:00.000Z (over 5 years ago)
- Default Branch: master
- Last Pushed: 2020-06-30T07:58:25.000Z (over 5 years ago)
- Last Synced: 2025-01-01T20:09:56.142Z (about 1 year ago)
- Language: Dockerfile
- Size: 1.95 KB
- Stars: 1
- Watchers: 2
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# kafka-fluentd-docker
- Dockerised [Fluentd](https://www.fluentd.org/) pushing logs to an [Apache Kafka](http://kafka.apache.org/) topic
# Pre-requisites
- Assuming that you have kafka broker along with zookeeper running
- Knowledge of Docker and fluentd
- Make sure to edit the fluentd.conf as per your needs ( the default one is just a template to help you get started)
- Refer [fluent-plugin-kafka](https://github.com/fluent/fluent-plugin-kafka) to make necessary changes in the conf file.
# How to build docker
- sudo docker build -t kafka-fluentd-docker .
## Note
- Tested where fluentd is running in a [k8s](https://kubernetes.io/) cluster. This can also be run as standalone docker by doing necessary changes in the config file.
- Refer to [kafka-fluentd-k8-s-yaml](https://github.com/sai3010/kafka-fluentd-k8-s-yaml) yaml files in order to run this on kubernetes cluster.