Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/hartfordfive/kafka-topic-tailer
https://github.com/hartfordfive/kafka-topic-tailer
Last synced: about 8 hours ago
JSON representation
- Host: GitHub
- URL: https://github.com/hartfordfive/kafka-topic-tailer
- Owner: hartfordfive
- License: mit
- Created: 2020-03-07T12:33:43.000Z (over 4 years ago)
- Default Branch: master
- Last Pushed: 2020-05-28T00:58:17.000Z (over 4 years ago)
- Last Synced: 2024-06-20T07:57:04.352Z (5 months ago)
- Language: Go
- Size: 14.6 KB
- Stars: 0
- Watchers: 2
- Forks: 0
- Open Issues: 1
-
Metadata Files:
- Readme: README.md
- License: LICENSE.md
Awesome Lists containing this project
README
## kafka-topic-tailer
### Description
This utility is intended to allow you to directly tail logs from kafka, which have been published there via filebeat, instead of waiting until they've been processed and become available at the final destination (typically Elasticsearch).
### Flags
* `-brokers` : (string) Comma separated list of brokers in IP:PORT format
* `-json` : Parse log entry and only display `@timestamp`, `beat.hostname` and `message` fields (default: `false`)
* `-kver` : (string) Version of Kafka (default: `2.1.0`)
* `-oldest` : Start the kafka consumer from oldest ofset (default: `true`)
* `-topic` : (string) Name of the kafka topic to consume from
* `-r` : (string) Regex to filter for specific messages
* `-tz` : (string) Convert the **@timestamp** value to a timezone of your choice. (default: `Etc/UTC`)
* `-d` : Enable debug mode logging
* `-v` : Print version info and exit### Command usage example
./kafka-topic-tailer -brokers "kafka01:2181,kafka02:2181,kafka03:2181" -topic "my-log-topic" -tz "America/Chicago"
### Download pre-compiled builds
The pre-compiled releases can be found [here](https://github.com/hartfordfive/kafka-topic-tailer/releases)
### Building from source
Building for your specific OS:
* `make build`Building for the three main OS varieties (Linux, Darwin & Windows):
* `make build-all`Building with debug symbols present:
* `make build-debug`*See Makefile for all available options*