https://github.com/echojc/kafka-offset-exporter

Prometheus exporter for Kafka topic and consumer group offsets
https://github.com/echojc/kafka-offset-exporter

Last synced: 4 months ago
JSON representation

Prometheus exporter for Kafka topic and consumer group offsets

• Host: GitHub
• URL: https://github.com/echojc/kafka-offset-exporter
• Owner: echojc
• Created: 2017-04-07T05:13:24.000Z (over 7 years ago)
• Default Branch: master
• Last Pushed: 2023-10-27T19:04:46.000Z (about 1 year ago)
• Last Synced: 2024-07-22T01:33:34.204Z (4 months ago)
• Language: Go
• Size: 15.6 KB
• Stars: 27
• Watchers: 4
• Forks: 36
• Open Issues: 6
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

• awesome-kafka - Kafka Offset Exporter

README

        
# kafka-offset-exporter

----

## no longer maintained

My employer used to rely heavily on Kafka and so I could dogfood and iterate on

this project regularly. Unfortunately, this is no longer the case and I don't

have the resources to maintain and/or develop this anymore.

I don't feel comfortable recommending people to use outdated and unmaintained

software, so please consider using an established fork, forking this yourself,

or creating a new-and-improved exporter as an alternative.

Thanks all!

----

This is a Prometheus exporter for topic and consumer group offsets in Kafka.

Your Kafka cluster must be on version 0.10.0.0 or above for this to work.

## Usage

The only required parameter is a set of brokers to bootstrap into the cluster.

By default, the oldest and newest offsets of all topics are retrieved and

reported.  You can also enable offset reporting for any consumer group but note

that due to the way Sarama works, this requires querying for offsets for _all_

partitions for each consumer group which can take a long time. It is recommended

to filter both topics and consumer groups to just the ones you care about.

```

$ ./kafka-offset-exporter -help

Usage of ./kafka-offset-exporter:

  -brokers string

        Kafka brokers to connect to, comma-separated

  -fetchMax duration

        Max time before requesting updates from broker (default 40s)

  -fetchMin duration

        Min time before requesting updates from broker (default 15s)

  -groups string

        Also fetch offsets for consumer groups matching this regex (default none)

  -level string

        Logger level (default "info")

  -path string

        Path to export metrics on (default "/")

  -port int

        Port to export metrics on (default 9000)

  -refresh duration

        Time between refreshing cluster metadata (default 1m0s)

  -topics string

        Only fetch offsets for topics matching this regex (default all)

```