Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

https://github.com/raystack/dagger

Dagger is an easy-to-use, configuration over code, cloud-native framework built on top of Apache Flink for stateful processing of real-time streaming data.

apache-flink apache-kafka dataops framework influxdb prometheus real-time-analytics real-time-processing stream-processing

Last synced: 01 Jul 2024

https://github.com/raystack/firehose

Firehose is an extensible, no-code, and cloud-native service to load real-time streaming data from Kafka to data stores, data lakes, and analytical storage systems.

apache-kafka bigquery dataops firehose influxdb kafka postgresql prometheus sink streaming

Last synced: 01 Jul 2024

https://github.com/DataCater/datacater

The developer-friendly ETL platform for transforming data in real-time. Based on Apache Kafka® and Kubernetes®.

apache-kafka cloud-native data-pipelines etl kafka kubernetes python

Last synced: 21 Jun 2024

https://github.com/Harry-027/go-notify

An email automation solution, written in Golang.

apache-kafka cobra go gofiber golang grafana k6 postgres prometheus redis

Last synced: 09 Jun 2024

https://github.com/streamnative/kop

Kafka-on-Pulsar - A protocol handler that brings native Kafka protocol to Apache Pulsar

apache-kafka apache-pulsar dotnet event-streaming kafka kafka-on-pulsar kop pub-sub pubsub pulsar

Last synced: 07 Jun 2024

https://github.com/Aiven-Open/tiered-storage-for-apache-kafka

RemoteStorageManager for Apache Kafka® Tiered Storage

apache-kafka kafka tiered-storage

Last synced: 07 Jun 2024

https://github.com/artie-labs/transfer

Database replication platform that leverages change data capture. Stream production data from databases to your data warehouse (Snowflake, BigQuery, Redshift) in real-time.

apache-kafka bigquery cdc change-data-capture data-integration data-pipelines database debezium elt golang kafka redshift snowflake

Last synced: 07 Jun 2024

https://github.com/karafka/rdkafka-ruby

Modern and performant Kafka client library for Ruby based on librdkafka

apache-kafka apache-kafka-consumer apache-kafka-producer kafka librdkafka ruby

Last synced: 02 Jun 2024

https://github.com/gvolpe/trading

💱 Trading application written in Scala 3 that showcases an Event-Driven Architecture (EDA) and Functional Programming (FP)

apache-kafka apache-pulsar cats-effect eda elm elm-architecture elm-lang event-driven-architecture fp fs2 functional-programming grafana open-tracing prometheus scala scala3 web-sockets websockets

Last synced: 02 Jun 2024

https://github.com/debezium/debezium

Change data capture for a variety of databases. Please log issues at https://issues.redhat.com/browse/DBZ.

apache-kafka cdc change-data-capture database debezium event-streaming kafka kafka-connect kafka-producer

Last synced: 02 Jun 2024

https://github.com/redpanda-data/console

Redpanda Console is a developer-friendly UI for managing your Kafka/Redpanda workloads. Console gives you a simple, interactive approach for gaining visibility into your topics, masking data, managing consumer groups, and exploring real-time data with time-travel debugging.

apache-kafka dataops go kafka kafka-gui kafka-ui react typescript web-ui

Last synced: 09 May 2024

https://github.com/mmolimar/ksql-jdbc-driver

JDBC driver for Apache Kafka

apache-kafka confluent driver jdbc kafka ksql ksqldb

Last synced: 07 May 2024

https://github.com/fgeller/kt

Kafka command line tool that likes JSON

apache-kafka cli golang json kafka

Last synced: 07 May 2024

https://github.com/OryxProject/oryx

Oryx 2: Lambda architecture on Apache Spark, Apache Kafka for real-time large scale machine learning

apache-kafka apache-spark cloudera java kafka lambda-architecture machine-learning oryx

Last synced: 02 May 2024

https://github.com/zarusz/SlimMessageBus

Lightweight message bus interface for .NET (pub/sub and request-response) with transport plugins for popular message brokers.

apache-kafka avro azure azure-event-hubs azure-service-bus bus c-sharp ddd dotnet kafka message-bus messaging mqtt pub-sub rabbitmq redis request-response

Last synced: 25 Apr 2024

https://github.com/quixio/quix-streams

Quix Streams - A library for data streaming and Python Stream Processing

apache-kafka kafka python stream-processing

Last synced: 11 Apr 2024

https://github.com/streamthoughts/azkarra-streams

🚀 Azkarra is a lightweight java framework to make it easy to develop, deploy and manage cloud-native streaming microservices based on Apache Kafka Streams.

apache-kafka azkarra-streams cloud-native data interactive-queries java kafka kafka-streams micro-framework microservices webui

Last synced: 26 Mar 2024

https://github.com/jwplayer/southpaw

:baseball: Streaming left joins in Kafka for change data capture

apache-kafka cdc change-data-capture debezium distributed-systems java kafka rocksdb southpaw

Last synced: 26 Mar 2024

https://github.com/Parsely/pykafka

Apache Kafka client for Python; high-level & low-level consumer/producer, with great performance.

apache-kafka c-extension kafka python

Last synced: 26 Mar 2024

https://github.com/deviceinsight/kafkactl

Command Line Tool for managing Apache Kafka

apache-kafka avro cli fish golang kafka zsh

Last synced: 22 Mar 2024

https://github.com/Farfetch/kafkaflow

Apache Kafka .NET Framework to create applications simple to use and extend.

apache-kafka c-sharp consumer csharp dotnet dotnetcore farfetch hacktoberfest kafka kafka-client kafka-clients kaflaflow middlewares nuget workers

Last synced: 19 Mar 2024

https://github.com/andrewinci/Insulator

A client UI to inspect Kafka topics, consume, produce and much more

apache-kafka avro consumer javafx kafka kafka-consumer kotlin schema topic tornadofx ui

Last synced: 16 Mar 2024