awesome-kafka
A curated list of awesome things related to Apache Kafka
https://github.com/semantalytics/awesome-kafka
Last synced: 2 days ago
JSON representation
-
Libraries
-
Kafka
- sarama - Sarama is an MIT-licensed Go client library for Apache Kafka version 0.8 (and later).
- kadeck - Apache Kafka Monitoring, Kafka UI and data platform for Desktop or Web.
- conduktor
- schema-registry-ui - Web tool for Avro Schema Registry.
- kafkacat - Generic command line non-JVM Apache Kafka producer and consumer.
- reactive-kafka - Alpakka Kafka connector - Alpakka is a Reactive Enterprise Integration library for Java and Scala, based on Reactive Streams and Akka.
- sarama - Sarama is an MIT-licensed Go client library for Apache Kafka version 0.8 (and later).
- kadeck - Apache Kafka Monitoring, Kafka UI and data platform for Desktop or Web.
- schema-registry-ui - Web tool for Avro Schema Registry.
- kafkacat - Generic command line non-JVM Apache Kafka producer and consumer.
- kafkahq - Kafka GUI for topics, topics data, consumers group, schema registry, connect and more.
- reactive-kafka - Alpakka Kafka connector - Alpakka is a Reactive Enterprise Integration library for Java and Scala, based on Reactive Streams and Akka.
- chaperone - A Kafka audit system.
- kafka-eagle - Used to monitor the consumer status of Kafka clusters, as well as offsets, metadata and other information.
- dockerkafka - DoctorKafka is a service for Kafka cluster auto healing and workload balancing.
- kasper - Kasper is a lightweight library for processing Kafka topics.
- Kafka Manager - Web-based tool for managing a Kafka cluster.
- topicctl - A tool for easy, declarative management of Kafka topics. Includes the ability to "apply" topic changes from YAML as well as a repl for interactive exploration of brokers, topics, consumer groups, messages, and more.
- mirus - Mirus is a cross data-center data replication tool for Apache Kafka.
- kareldb - A Relational Database Backed by Apache Kafka.
- kcache - An In-Memory Cache Backed by Apache Kafka.
- kafka-lag-based-assignor - Kafka partition assignor that distributes lag evenly across a consumer group.
- kafka-pixy - Kafka-Pixy is a dual API (gRPC and REST) proxy for Kafka with automatic consumer group control.
- Burrow - Kafka Consumer Lag Checking.
- kafka-tools - A collection of tools for working with Apache Kafka.
- kafka-jackson - Kafka Serializer, Deserializer, and Serde for Jackson JSON.
- secor - Secor is a service implementing Kafka log persistence.
- kafka-monitor
- uReplicator - Improvement of Apache Kafka Mirrormaker.
- kafka-websocket
- kafka-unit
- cruise-control - Cruise-control is the first of its kind to fully automate the dynamic workload rebalance and self-healing of a kafka cluster.
- jocko - Kafka implemented in Golang with built-in coordination (No ZK dep, single binary install, Cloud Native).
- hermes - Fast and reliable message broker built on top of Kafka.
- kt - Kafka command line tool.
- Yelp kafka-utils
- kafka-spark-consumer
- kafka-streams-cep - Complex Event Processing on top of Kafka Streams.
- spring-kafka
- ksql-machine-learning-udf
- kafkabeat - Elasticsearch Beats for kafka.
- sangrenel
- Strimzi - Operator for deploying and running Apache Kafka on Kubernetes and OpenShift.
- Strimzi Kafka CLI - A CLI for Strimzi Kafka Operator.
- Kafka Cluster Kraft Mode - DockerCompose - Workable kafka cluster with kraft mode using docker-compose.
- Decaton - High throughput asynchronous task processing framework
- sarama - Sarama is an MIT-licensed Go client library for Apache Kafka version 0.8 (and later).
- kafkacat - Generic command line non-JVM Apache Kafka producer and consumer.
- schema-registry-ui - Web tool for Avro Schema Registry.
- kafkahq - Kafka GUI for topics, topics data, consumers group, schema registry, connect and more.
- reactive-kafka - Alpakka Kafka connector - Alpakka is a Reactive Enterprise Integration library for Java and Scala, based on Reactive Streams and Akka.
- chaperone - A Kafka audit system.
- kafka-eagle - Used to monitor the consumer status of Kafka clusters, as well as offsets, metadata and other information.
- kasper - Kasper is a lightweight library for processing Kafka topics.
- Kafka Manager - Web-based tool for managing a Kafka cluster.
-
Kafka UI
- akhq
- kafka-connect-ui - Web tool for Kafka Connect.
- kowl
- akhq
- KafkaTrail
- kafka-topics-ui
- Kafdrop - Web UI for browsing Kafka topics and consumer groups.
- kafka-webview
- kafka-view
- cruise-control-ui
- real-time-ui-with-kafka-streams
- tsujun - Yet another Web UI for KSQL.
-
Kafka Connect
- Apache Camel Kafka Connect - 340+ Apache Camel components as Kafka Connect connectors.
- Confluent Connector Hub
- Apache Camel Kafka Connect - 340+ Apache Camel components as Kafka Connect connectors.
- kafka-connect-transformers
- aiven-kafka-connect-transforms - A collection of Single Message Transformations (SMTs) for Kafka Connect.
- kafka-connect-file-pulse - A polyvalent, scalable and reliable, Kafka Connector that makes it easy to parse, transform and stream any file, in any format, into Apache Kafka.
- kafka-connect-http
- kafka-connect-client - A kafka-connect REST api client for java.
- kafka-connect-protobuf-converter - Protobuf converter plugin for Kafka Connect.
- Maxwell
- kafka-connect-mq-source
- kafka-connect-jenkins
- toketi-kafka-connect-iohub
- connectctl - Manage kafka connect connectors easily.
- kafka-connect-transform-common - Common Transforms for Kafka Connect.
- snowflake-kafka-connector
- Apache Camel Kafka Connect - 340+ Apache Camel components as Kafka Connect connectors.
-
Kafkaesque
-
Other Awesome Kafka
- ApacheKafka
- dharmeshkakadia/awesome-kafka
- infoslack/awesome-kafka
- awesome-kafka-playground
- ballerina-avro-kafka-serializer - Ballerina Confluent Avro Serializer/Deserializer
- ApacheKafka
-
Kafka Streams
- schema-registry-ui
- kafka-streams-consumer-offsets-to-json - A Kafka Streams process to convert consumer_offsets to a JSON-readable topic.
- kafka-operator
- kafkabalancer
- mockedstreams
- winton-kafka-streams - A Python implementation of Apache Kafka Streams.
-
REST Proxy
- kafka-rest - Confluent REST Proxy.
- strimzi-http-bridge - Strimzi Kafka Bridge (AMQP & HTTP).
- Zilla - An API gateway built for event-driven architectures and streaming that supports standard protocols such as HTTP, SSE, gRPC, MQTT and the native Kafka protocol.
-
Schema Registry
- apicurio-registry - Apicurio API/schema registry (includes UI).
- schema-registry - Confluent Schema registry for Kafka.
- ksql-jdbc-driver
- ballerina-schema-registry - Ballerina Confluent Schema Registry
-
-
Resources
-
Learning
-
Blogs
- CodingJunkie - Random Thoughts on Coding by Bill Bejeck.
- Understanding Kafka with Factorio
- CodingJunkie - Random Thoughts on Coding by Bill Bejeck.
-
Books
-
Programming Languages
Categories
Sub Categories
Keywords
kafka
37
kafka-connect
10
kafka-streams
7
java
5
messaging
5
schema-registry
4
avro
4
apache-kafka
4
confluent
4
kubernetes
4
json
4
kafka-connector
3
kafka-consumer
3
streaming
3
distributed-systems
3
kafka-ui
2
topic
2
python
2
kafka-rest-proxy
2
go
2
rest-api
2
queue
2
streaming-api
2
protobuf
2
cli
2
golang
2
openshift
2
grpc
2
http
2
proxy
2
rest
2
kafka-producer
2
event-streaming
2
pub-sub
2
kafka-cluster
2
kubernetes-operator
2
ksql
2
stream-processing
2
data-stream
1
data-streaming
1
consumer-group
1
kafka-zookeeperless
1
data-streams
1
kafka-kraft
1
kubernetes-controller
1
docker-compose
1
xml
1
strimzi
1
command-line-interface
1
grok-filters
1