Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
awesome-kafka
Everything about Apache Kafka
https://github.com/dharmeshkakadia/awesome-kafka
- Go
- Go
- Go
- Go Kafka streaming
- Node
- Node
- Node
- Node Kafka streams
- Node librdkafka
- Php
- Php
- Perl
- Python (asyncio)
- Python (kafka-python)
- Python (pykafka)
- Ruby
- Phobos - Ruby App framework
- Karafka - Ruby and Rails framework
- Dart
- JRuby
- Elixir
- Erlang
- Rust
- LinkedIn wrapper library
- kasper - a lightweight library for processing Kafka topics
- others
- Scala
- faust - Python Stream Processing
- Southpaw - Streaming left joins for data change capture
- KSQL JDBC Driver
- KSQL Addon - User Defined Function (UDF) for Machine Learning
- JDBC
- Elasticsearch
- HDFS
- Beast - Kafka to BigQuery Sink
- BigQuery
- SQL
- GCloud pubsub
- BigTable
- Google Cloud Storage (GCS)
- HBase
- FileSystem
- Streaming files from a local filesystem
- kafka-connect-protobuf-converter
- IBM MQ Source
- IBM MQ Sink
- Azure IoT Hub
- Pulsar
- HTTP
- Maxwell's daemon - a mysql-to-json kafka producer
- Spark
- Storm
- Mapreduce
- Divolte
- Azure Data Explorer/Kusto
- Firehose - Firehose is an extensible, no-code, and cloud-native service to load real-time streaming data from Kafka to data stores, data lakes, and analytical storage systems.
- Raccoon - Raccoon is a high-throughput, low-latency service to collect events in real-time from your web, mobile apps, and services using multiple network protocols and publish to Kafka.
- Dagger - Dagger is an easy-to-use, SQL framework to process built on top of Apache Flink for stateful processing of Kafka data.
- Single Message Transformations (SMT)
- Mocked Streams - Topology testing library for Kafka Streams (no broker required)
- Unit-testing for embedded kafka services
- Kafka JUnit
- Kafka Unit
- Kafka for JUnit
- Karate and Kafka
- embedded-kafka - in-memory Kafka instance to run your tests against
- Kafka Containers
- Mockintosh - through asynchronous Kafka actors
- kafka-gitops
- Cruise control
- DoctorKafka
- Brucke - Inter-cluster bridge of kafka topics
- Kafka-Kit
- Secor - service for persisting Kafka logs
- kafkabalancer
- Yelp Kafka-Utils
- Cerner Common Kafka utilities
- connectctl - manage kafka connect connectors easily
- Kafka Offset Exporter
- Fluent plugin
- Burrow - Kafka Consumer Lag Checking
- Remora
- Kafka Offset Monitoring
- kafka-eagle
- Kafka-prometheus
- Consumer lag monitoring
- sangrenel
- KLoadGen - load generator plugin for jmeter
- Kafka Security Manager
- Kafka security playbook
- chaperone - A Kafka audit system
- MirrorMaker
- Message Handler For MirrorMaker to change topic names
- uReplicator
- MirrorTool for Kafka Connect
- Mirus
- Backup and Restore topics & offsets
- Karapace - Your Kafka essentials in one tool
- REST-proxy
- Kafka-Pixy - gRPC/REST Proxy
- Kafka Proxy providing SASL/PLAIN authentication and SSL
- Reactive/Akka API
- kafkat
- kt
- kafka-connect-tools
- Node Kafka connect
- Kafka-monitor
- Kafka Auto completion
- Kafka Cheet Sheet
- Kafka Write Protocol encoder/decoder
- Winton Kafka Streams
- Spring-kafka
- Maven quick start for Kafka Connect connectors
- Trifecta
- Kafka Specs
- Strimzi Kafka CLI
- Go library for Kafka metadata in Zookeeper
- Meteor - Meteor is a scalable, easy-to-use, extensible metadata collection framework from the different cloud providers and on-prem sources and publish to Kafka.
- Stencil - Stencil is a Protobuf schema registry for Kafka that enables you to create, maintain and consume protobuf messages and APIs dynamically, efficiently, and reliably.
- Schema registry
- Node Schema registry
- Schema Registry Transfer SMT
- Expedia Stream Registry
- kafka-manager
- Kafka HQ
- Kafdrop 3.x
- Kafka Webview
- Kafka Topics UI
- Kafka Connect UI
- Kafka Schema UI
- Kafkawize - self service topic management portal
- Kadmin - Kafka Producer/Consumer UI
- Kowl
- Kafka Streams Topology Sketch Diagram Visualization
- Web based GUI
- Kafka k8s operator
- Strimzi
- konsumerator - Kafka Consumer Operator
- fast-data-dev
- Ecosystem
- hermes
- IBMStreams
- Brooklin
- Go
- C/C++
- In-Memory Cache Backed by Kafka
- ransactional Metadata Store Backed by Kafka
- Azkarra Streams - lightweight java framework which makes easy to create production-ready Kafka Streams applications
Programming Languages
Keywords
kafka
75
kafka-connect
18
apache-kafka
13
confluent
8
kafka-streams
8
kafka-client
7
kafka-connector
7
schema-registry
7
kubernetes
6
dataops
6
golang
5
stream-processing
5
java
5
nodejs
5
messaging
5
kafka-cluster
5
kafka-consumer
4
docker
4
kafka-manager
4
streaming
4
cli
4
etl
4
json
4
protobuf
4
python
4
big-data
4
avro
4
prometheus
4
distributed-systems
4
bigquery
3
schema
3
kafka-producer
3
topic
3
protocol-buffers
3
event-streaming
3
monitoring
3
scala
3
ruby
3
kubernetes-operator
3
zookeeper
3
streams
3
load-testing
2
avro-schema
2
go
2
json-schema
2
tool
2
acl
2
change-data-capture
2
ibm-mq
2
broker
2