https://github.com/johnpreston/kafka-connect-watcher
Kafka Connect Watcher
https://github.com/johnpreston/kafka-connect-watcher
aws kafka kafka-connect monitoring
Last synced: 4 months ago
JSON representation
Kafka Connect Watcher
- Host: GitHub
- URL: https://github.com/johnpreston/kafka-connect-watcher
- Owner: JohnPreston
- License: apache-2.0
- Created: 2023-03-21T06:25:49.000Z (over 3 years ago)
- Default Branch: main
- Last Pushed: 2025-06-14T08:22:29.000Z (about 1 year ago)
- Last Synced: 2026-02-17T20:37:53.194Z (5 months ago)
- Topics: aws, kafka, kafka-connect, monitoring
- Language: Python
- Homepage: http://kafka-connect-watcher.docs.compose-x.io/
- Size: 330 KB
- Stars: 3
- Watchers: 0
- Forks: 4
- Open Issues: 1
-
Metadata Files:
- Readme: README.rst
- License: LICENSE
Awesome Lists containing this project
README
===========================================
Kafka Connect Watcher
===========================================
Service that will actively probe and monitor your Kafka connect clusters using the Connect API.
It can report metrics to AWS CloudWatch (Prometheus coming) using `AWS EMF`_ to allow creating alerts
and alarms.
Features
=========
* Scan multiple clusters at once
* Implement different remediation rules
* Include/Exclude lists for connectors to evaluate/ignore
Roadmap
=========
* Prometheus support
* Multiple channels of alerts (i.e. webhooks)
Systems recommendations
------------------------------
When using multiple clusters, we recommend to provide multiple CPUs to the service as it
has multi-threading enabled, allowing for parallel processing of clusters & their respective connectors.
.. _AWS EMF: https://docs.aws.amazon.com/AmazonCloudWatch/latest/monitoring/CloudWatch_Embedded_Metric_Format_Specification.html