{"id":13564497,"url":"https://github.com/redpanda-data/kminion","last_synced_at":"2025-06-22T11:09:32.508Z","repository":{"id":38374315,"uuid":"170125122","full_name":"redpanda-data/kminion","owner":"redpanda-data","description":"KMinion is a feature-rich Prometheus exporter for Apache Kafka written in Go. It is lightweight and highly configurable so that it will meet your requirements.","archived":false,"fork":false,"pushed_at":"2025-05-05T11:14:05.000Z","size":8596,"stargazers_count":668,"open_issues_count":43,"forks_count":129,"subscribers_count":54,"default_branch":"master","last_synced_at":"2025-06-22T10:40:26.900Z","etag":null,"topics":["consumer","consumer-group","exporter","group","kafka","lag","prometheus","prometheus-exporter"],"latest_commit_sha":null,"homepage":"","language":"Go","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/redpanda-data.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2019-02-11T12:28:56.000Z","updated_at":"2025-06-19T13:26:15.000Z","dependencies_parsed_at":"2024-01-14T03:49:03.133Z","dependency_job_id":"7acfb156-a120-430f-aa01-7857d47e0ae5","html_url":"https://github.com/redpanda-data/kminion","commit_stats":null,"previous_names":["cloudhut/kminion","cloudworkz/kafka-minion","google-cloud-tools/kafka-minion"],"tags_count":22,"template":false,"template_full_name":null,"purl":"pkg:github/redpanda-data/kminion","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/redpanda-data%2Fkminion","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/redpanda-data%2Fkminion/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/redpanda-data%2Fkminion/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/redpanda-data%2Fkminion/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/redpanda-data","download_url":"https://codeload.github.com/redpanda-data/kminion/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/redpanda-data%2Fkminion/sbom","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":261282315,"owners_count":23134940,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["consumer","consumer-group","exporter","group","kafka","lag","prometheus","prometheus-exporter"],"created_at":"2024-08-01T13:01:32.192Z","updated_at":"2025-06-22T11:09:27.490Z","avatar_url":"https://github.com/redpanda-data.png","language":"Go","funding_links":[],"categories":["Go","Management \u0026 Monitoring"],"sub_categories":["Metrics \u0026 Exporters"],"readme":"# Prometheus Exporter for Apache Kafka - KMinion\n\nKMinion (previously known as Kafka Minion) is a feature-rich and flexible Prometheus Exporter to monitor your Apache\nKafka cluster. All valuable information that are accessible via the Kafka protocol are supposed to be accessible using\nKMinion.\n\n## 🚀 Features\n\n- **Kafka versions:** Supports all Kafka versions v0.11+\n- **Supported SASL mechanisms:** plain, scram-sha-256/512, gssapi/kerberos\n- **TLS support:** TLS is supported, regardless whether you need mTLS, a custom CA, encrypted keys or just the trusted\n  root certs\n- **Consumer Group Lags:** Number of messages a consumer group is lagging behind the latest offset\n- **Log dir sizes:** Metric for log dir sizes either grouped by broker or by topic\n- **Broker info:** Metric for each broker with its address, broker id, controller and rack id\n- **Configurable granularity:** Export metrics (e.g. consumer group lags) either per partition or per topic. Helps to reduce the number of exported metric series.\n- **End to End Monitoring:** Sends messages to its own topic and consumes them, measuring a messages real-world \"roundtrip\" latency. Also provides ack-latency and offset-commit-latency. [More Info](/docs/end-to-end.md)\n- **Configurable targets:** You can configure what topics or groups you'd like to export using regex expressions\n- **Multiple config parsers:** It's possible to configure KMinion using YAML, Environment variables or a mix of both\n\nYou can find a list of all exported metrics here: [/docs/metrics.md](/docs/metrics.md)\n\n## Getting started\n\n### 🐳 Docker image\n\nAll images will be built on each push to master or for every new release. You can find an overview of all available tags\nin our [DockerHub repository](https://hub.docker.com/r/redpandadata/kminion/tags).\n\n```shell\ndocker pull redpandadata/kminion:latest\n```\n\n### ☸ Helm chart\n\nA Helm chart will be maintained as part of Redpanda's [helm-charts](https://github.com/redpanda-data/helm-charts/tree/main/charts/kminion) repository.\n\n### 🔧 Configuration\n\nAll options in KMinion can be configured via YAML or environment variables. Configuring some options via YAML and some\nvia environment variables is also possible. Environment variables take precedence in this case. You can find the\nreference config with additional documentation in [/docs/reference-config.yaml](/docs/reference-config.yaml).\n\nIf you want to use a YAML config file, specify the path to the config file by setting the env variable\n`CONFIG_FILEPATH`.\n\n### 📊 Grafana Dashboards\n\nI uploaded three separate Grafana dashboards that can be used as inspiration in order to create your own dashboards. Please take note that these dashboards might not immediately work for you due to different labeling in your Prometheus config.\n\nCluster Dashboard: https://grafana.com/grafana/dashboards/14012\n\nConsumer Group Dashboard: https://grafana.com/grafana/dashboards/14014\n\nTopic Dashboard: https://grafana.com/grafana/dashboards/14013\n\n\u003cp float=\"left\"\u003e\n  \u003cimg src=\"/docs/screenshots/kminion-cluster.png\" width=\"250\" /\u003e\n  \u003cimg src=\"/docs/screenshots/kminion-groups.png\" width=\"250\" /\u003e \n  \u003cimg src=\"/docs/screenshots/kminion-topics.png\" width=\"250\" /\u003e\n\u003c/p\u003e\n\n### ⚡ Testing locally\n\nThis repo contains a docker-compose file that you can run on your machine. It will spin up a Kafka \u0026 ZooKeeper cluster\nand starts KMinion on port 8080 which is exposed to your host machine:\n\n```shell\n# 1. Clone this repo\n# 2. Browse to the repo's root directory and run:\ndocker-compose up\n```\n\n## Chat with us\n\nWe use Slack to communicate. If you are looking for more interactive discussions or support, you are invited to join\nour Slack server: https://redpanda.com/slack\n\n## License\n\nKMinion is distributed under the [MIT License](https://github.com/cloudhut/kminion/blob/master/LICENSE).\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fredpanda-data%2Fkminion","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fredpanda-data%2Fkminion","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fredpanda-data%2Fkminion/lists"}