Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/provectus/kafka-ui
Open-Source Web UI for Apache Kafka Management
apache-kafka big-data cluster-management event-streaming hacktoberfest kafka kafka-brokers kafka-client kafka-cluster kafka-connect kafka-manager kafka-producer kafka-streams kafka-ui opensource streaming-data streams web-ui
Last synced: 01 Jul 2024
https://github.com/raystack/dagger
Dagger is an easy-to-use, configuration over code, cloud-native framework built on top of Apache Flink for stateful processing of real-time streaming data.
apache-flink apache-kafka dataops framework influxdb prometheus real-time-analytics real-time-processing stream-processing
Last synced: 01 Jul 2024
https://github.com/raystack/firehose
Firehose is an extensible, no-code, and cloud-native service to load real-time streaming data from Kafka to data stores, data lakes, and analytical storage systems.
apache-kafka bigquery dataops firehose influxdb kafka postgresql prometheus sink streaming
Last synced: 01 Jul 2024
https://github.com/DataCater/datacater
The developer-friendly ETL platform for transforming data in real-time. Based on Apache Kafka® and Kubernetes®.
apache-kafka cloud-native data-pipelines etl kafka kubernetes python
Last synced: 21 Jun 2024
https://github.com/Harry-027/go-notify
An email automation solution, written in Golang.
apache-kafka cobra go gofiber golang grafana k6 postgres prometheus redis
Last synced: 09 Jun 2024
https://github.com/streamnative/kop
Kafka-on-Pulsar - A protocol handler that brings native Kafka protocol to Apache Pulsar
apache-kafka apache-pulsar dotnet event-streaming kafka kafka-on-pulsar kop pub-sub pubsub pulsar
Last synced: 07 Jun 2024
https://github.com/Aiven-Open/tiered-storage-for-apache-kafka
RemoteStorageManager for Apache Kafka® Tiered Storage
apache-kafka kafka tiered-storage
Last synced: 07 Jun 2024
https://github.com/artie-labs/transfer
Database replication platform that leverages change data capture. Stream production data from databases to your data warehouse (Snowflake, BigQuery, Redshift) in real-time.
apache-kafka bigquery cdc change-data-capture data-integration data-pipelines database debezium elt golang kafka redshift snowflake
Last synced: 07 Jun 2024
https://github.com/karafka/waterdrop
Standalone Karafka library for producing Kafka messages
apache-kafka apache-kafka-producer kafka karafka karafka-application karafka-framework ruby ruby-kafka rubygem rubygems waterdrop
Last synced: 02 Jun 2024
https://github.com/karafka/rdkafka-ruby
Modern and performant Kafka client library for Ruby based on librdkafka
apache-kafka apache-kafka-consumer apache-kafka-producer kafka librdkafka ruby
Last synced: 02 Jun 2024
https://github.com/gvolpe/trading
💱 Trading application written in Scala 3 that showcases an Event-Driven Architecture (EDA) and Functional Programming (FP)
apache-kafka apache-pulsar cats-effect eda elm elm-architecture elm-lang event-driven-architecture fp fs2 functional-programming grafana open-tracing prometheus scala scala3 web-sockets websockets
Last synced: 02 Jun 2024
https://github.com/debezium/debezium
Change data capture for a variety of databases. Please log issues at https://issues.redhat.com/browse/DBZ.
apache-kafka cdc change-data-capture database debezium event-streaming kafka kafka-connect kafka-producer
Last synced: 02 Jun 2024
https://github.com/mmolimar/kukulcan
A REPL for Apache Kafka
ammonite apache-kafka java kafka kafka-admin kafka-connect kafka-consumer kafka-producer kafka-repl kafka-shell kafka-streams python repl scala shell
Last synced: 14 May 2024
https://github.com/redpanda-data/console
Redpanda Console is a developer-friendly UI for managing your Kafka/Redpanda workloads. Console gives you a simple, interactive approach for gaining visibility into your topics, masking data, managing consumer groups, and exploring real-time data with time-travel debugging.
apache-kafka dataops go kafka kafka-gui kafka-ui react typescript web-ui
Last synced: 09 May 2024
https://github.com/infoslack/awesome-kafka
A list about Apache Kafka
apache-kafka apache-spark data-pipeline data-processing infrastructure kafka kafka-streams stream-processing streaming-data
Last synced: 07 May 2024
https://github.com/mmolimar/ksql-jdbc-driver
JDBC driver for Apache Kafka
apache-kafka confluent driver jdbc kafka ksql ksqldb
Last synced: 07 May 2024
https://github.com/systemcraftsman/strimzi-kafka-cli
Command Line Interface for the Strimzi Kafka Operator
apache-kafka cli command-line-interface command-line-tool hacktoberfest kafka kubernetes messaging openshift strimzi
Last synced: 07 May 2024
https://github.com/fgeller/kt
Kafka command line tool that likes JSON
apache-kafka cli golang json kafka
Last synced: 07 May 2024
https://github.com/OryxProject/oryx
Oryx 2: Lambda architecture on Apache Spark, Apache Kafka for real-time large scale machine learning
apache-kafka apache-spark cloudera java kafka lambda-architecture machine-learning oryx
Last synced: 02 May 2024
https://github.com/confluentinc/librdkafka
The Apache Kafka C/C++ library
apache-kafka c c-plus-plus consumer high-performance kafka kafka-consumer kafka-producer librdkafka
Last synced: 02 May 2024
https://github.com/karafka/karafka
Ruby and Rails efficient Kafka processing framework
active-job activejob-backend apache-kafka background-jobs events kafka kafka-client kafka-clients kafka-consumer kafka-manager kafka-monitor kafka-producer kafka-ruby karafka-framework opensource rails ruby ruby-library ruby-on-rails rubyonrails
Last synced: 01 May 2024
https://github.com/zarusz/SlimMessageBus
Lightweight message bus interface for .NET (pub/sub and request-response) with transport plugins for popular message brokers.
apache-kafka avro azure azure-event-hubs azure-service-bus bus c-sharp ddd dotnet kafka message-bus messaging mqtt pub-sub rabbitmq redis request-response
Last synced: 25 Apr 2024
https://github.com/rjurney/Agile_Data_Code_2
Code for Agile Data Science 2.0, O'Reilly 2017, Second Edition
agile-data agile-data-science airflow amazon-ec2 amazon-web-services analytics apache-kafka apache-spark data data-science data-syndrome kafka machine-learning machine-learning-algorithms predictive-analytics python python-3 python3 spark vagrant
Last synced: 17 Apr 2024
https://github.com/streamnative/awesome-pulsar
A curated list of Pulsar tools, integrations and resources.
apache-bookkeeper apache-flink apache-kafka apache-pulsar apache-spark apache-storm elastic-beats grafana-dashboard messaging prometheus pub-sub spark spark-sql spark-structured-streaming
Last synced: 11 Apr 2024
https://github.com/quixio/quix-streams
Quix Streams - A library for data streaming and Python Stream Processing
apache-kafka kafka python stream-processing
Last synced: 11 Apr 2024
https://github.com/streamthoughts/azkarra-streams
🚀 Azkarra is a lightweight java framework to make it easy to develop, deploy and manage cloud-native streaming microservices based on Apache Kafka Streams.
apache-kafka azkarra-streams cloud-native data interactive-queries java kafka kafka-streams micro-framework microservices webui
Last synced: 26 Mar 2024
https://github.com/streamnative/pulsar-io-kafka
Pulsar IO Kafka Connector
apache-kafka apache-pulsar event-streaming kafka pubsub pulsar pulsar-io schema schema-registry
Last synced: 26 Mar 2024
https://github.com/mmolimar/kafka-connect-fs
Kafka Connect FileSystem Connector
apache-kafka azure-storage confluent files filesystem ftp gcp hadoop hadoop-filesystem hdfs kafka kafka-connect kafka-connect-fs kafka-connector s3
Last synced: 26 Mar 2024
https://github.com/confluentinc/kafka-connect-hdfs
Kafka Connect HDFS connector
apache-kafka big-data confluent hadoop hdfs kafka kafka-connect-hdfs kafka-connector streaming
Last synced: 26 Mar 2024
https://github.com/jwplayer/southpaw
:baseball: Streaming left joins in Kafka for change data capture
apache-kafka cdc change-data-capture debezium distributed-systems java kafka rocksdb southpaw
Last synced: 26 Mar 2024
https://github.com/Parsely/pykafka
Apache Kafka client for Python; high-level & low-level consumer/producer, with great performance.
apache-kafka c-extension kafka python
Last synced: 26 Mar 2024
https://github.com/deviceinsight/kafkactl
Command Line Tool for managing Apache Kafka
apache-kafka avro cli fish golang kafka zsh
Last synced: 22 Mar 2024
https://github.com/Farfetch/kafkaflow
Apache Kafka .NET Framework to create applications simple to use and extend.
apache-kafka c-sharp consumer csharp dotnet dotnetcore farfetch hacktoberfest kafka kafka-client kafka-clients kaflaflow middlewares nuget workers
Last synced: 19 Mar 2024
https://github.com/andrewinci/Insulator
A client UI to inspect Kafka topics, consume, produce and much more
apache-kafka avro consumer javafx kafka kafka-consumer kotlin schema topic tornadofx ui
Last synced: 16 Mar 2024
https://github.com/joowani/kq
Kafka-based Job Queue for Python
apache-kafka job-queue kafka kafka-client kafka-consumer kafka-producer producer-consumer python python3 queueing worker-queue
Last synced: 14 Mar 2024