Data

Tools

Indexes

Applications

Experiments

Awesome

An open API service indexing awesome lists of open source software.

Projects in Awesome Lists tagged with confluent

A curated list of projects in awesome lists tagged with confluent .

https://github.com/timeplus-io/proton

High-performance, low-footprint SQL database written in C++. Process millions of rows per second from Kafka/Pulsar, Iceberg, or ClickHouse, and seamlessly write results back. Supports powerful features like JOIN, CDC, UPSERT, and LOOKUP, enabling real-time analytics and ETL at scale.

analytics clickhouse confluent cpp flink-alternative high-performance iceberg kakfa ksqldb-alternative redpanda simd single-binary sql stream-processing streaming-sql udf

Last synced: 14 May 2025

https://github.com/vdesabou/kafka-docker-playground

🐳✨ Fully automated Apache Kafka® and Confluent Docker based examples // 👷‍♂️ Easily build examples or reproduction models

confluent confluent-cloud confluent-kafka confluent-platform kafka kafka-connect kafka-connectors

Last synced: 14 May 2025

https://github.com/riferrei/srclient

Golang Client for Schema Registry

apache avro cloud codec confluent go kafka registry schema

Last synced: 15 May 2025

https://github.com/strech/avrora

A convenient Elixir library to work with Avro messages, schemas and Confluent® Schema Registry

avro avro-schema confluent elixir kafka schema-registry

Last synced: 15 May 2025

https://github.com/domnikl/schema-registry-gitops

Manage Confluent Schema Registry subjects through Infrastructure as code

ci-cd confluent devops infrastructure-as-code kafka schema-registry schema-validation yaml

Last synced: 06 Apr 2025

https://github.com/mmolimar/ksql-jdbc-driver

JDBC driver for Apache Kafka

apache-kafka confluent driver jdbc kafka ksql ksqldb

Last synced: 03 May 2025

https://github.com/ivangfr/springboot-kafka-connect-debezium-ksqldb

Experiment with Kafka, Debezium, and ksqlDB. research-service: Performs MySQL record manipulation. Source Connectors: Monitor MySQL changes, push messages to Kafka. Sink Connectors and kafka-research-consumer: Listen to Kafka, insert/update Elasticsearch. ksqlDB-Server: Listens to Kafka, performs joins, and pushes new messages to new Kafka topics.

avro confluent debezium elasticsearch java json kafka kafka-connect ksqldb mysql schema-registry spring-boot spring-data-jpa spring-kafka spring-web-mvc springdoc-openapi

Last synced: 30 Mar 2025

https://github.com/oslabs-beta/kafkaesk

An event-driven monitoring tool that can consume messages from Apache Kafka clusters and display the aggregated data on a dashboard for analysis and maintenance.

apache-kafka chartjs confluent ksqldb react websocket

Last synced: 30 Apr 2025

https://github.com/flix-tech/avro-serde-php

Avro Serialisation/Deserialisation (SerDe) library for PHP 8.1+ with a Symfony Serializer integration

avro avro-format avro-schema confluent confluent-platform deserialization php serde serialization symfony symfony-serializer

Last synced: 08 Apr 2025

https://github.com/OneCricketeer/schema-registry-transfer-smt

Kafka Connect Transform to copy Avro schemas between Schema Registries

avro confluent kafka kafka-connect kafka-connect-smt schema-registry

Last synced: 11 May 2025

https://github.com/onecricketeer/schema-registry-transfer-smt

Kafka Connect Transform to copy Avro schemas between Schema Registries

avro confluent kafka kafka-connect kafka-connect-smt schema-registry

Last synced: 20 Nov 2024

https://github.com/flix-tech/schema-registry-php-client

A PHP 8+ API client for the Confluent Schema Registry REST API based on Guzzle 7 - http://docs.confluent.io/current/schema-registry/docs/index.html

api-client avro avro-schema confluent event-driven-architecture guzzlehttp php schema-evolution schema-registry

Last synced: 05 Apr 2025

https://github.com/confluentinc/cp-ansible

Ansible playbooks for the Confluent Platform

ansible confluent kafka kafka-connect ksql playbook rest-proxy schema-registry

Last synced: 09 May 2025

https://github.com/gamussa/springboot-kafka-avro

A simple Spring Boot app that talks to Kafka using Avro and Schema Registry

avro avro-schema confluent kafka schema-registry

Last synced: 06 Dec 2024

https://github.com/confluentinc/kafka-connect-jdbc

Kafka Connect connector for JDBC-compatible databases

confluent jdbc kafka kafka-connector streaming

Last synced: 11 May 2025

https://github.com/ovotech/kafka-avro-confluent

Kafka De/Serializer using avro and Confluent's Schema Registry

avro company-kaluza confluent kafka

Last synced: 13 Apr 2025

https://github.com/findinpath/testcontainers-kafka-avro

Showcase on producing&consuming avro messages in Apache Kafka testcontainers ecosystem

avro confluent kafka testcontainers

Last synced: 02 Dec 2024

https://github.com/jcustenborder/puppet-confluent

Puppet Module for installing and configuring the Confluent Platform

confluent kafka puppet schema-registry

Last synced: 15 Feb 2025

https://github.com/fyndiq/eventsourcing_helpers

Python library for practicing the event sourcing pattern using DDD

confluent ddd event-sourcing kafka python

Last synced: 15 Apr 2025

https://github.com/oracle-quickstart/oci-confluent

Terraform module to deploy Confluent on Oracle Cloud Infrastructure (OCI)

cloud confluent kafka oci oracle partner-led terraform

Last synced: 13 Apr 2025

https://github.com/burdiyan/schemagen

Generate Go code from Avro schemas stored in Confluent Schema Registry

avro code-generation confluent go golang kafka schema schema-registry

Last synced: 12 May 2025

https://github.com/jcustenborder/confluent-ansible

Ansible playbook for installing the Confluent Platform

ansible confluent confluent-kafka kafka

Last synced: 15 Feb 2025

https://github.com/tirth27/real-time-analytics-with-spark-streaming

This project aims to build a streaming application to perform real-time analytics of Covid-19 related tweets and deploy an ML model for real-time sentiment predictions.

apache apache-avro apache-kafka apache-spark confluent docker docker-compose ksql spark-sql spark-streaming twitter-api

Last synced: 05 Mar 2025

https://github.com/rogervinas/spring-cloud-stream-kafka-confluent-avro-schema-registry

🍀 Spring Cloud Stream Kafka & Confluent Avro Schema Registry

avro confluent kafka kotlin spring-cloud-stream

Last synced: 16 Apr 2025

https://github.com/r-spark/sparklyr.confluent.avro

Confluent Schema Registry avro support for sparklyr

avro confluent rstats spark sparklyr

Last synced: 01 Mar 2025

https://github.com/sylhare/kafka

Kafka experimentation

avro confluent consumer kafka kotlin producer

Last synced: 04 Mar 2025

https://github.com/rudikone/avroschema-wizard-plugin

Streamline Avro schema registration and compatibility checks in Kafka with the avroschema-wizard-plugin, simplifying testing and integration with ease!

avro avro-kafka avro-schema confluent gradle java kafka kafka-schema-registry kotlin schema-registry

Last synced: 27 Feb 2025

https://github.com/imrafaelmerino/avro-spec

avro-spec empowers you to create Avro schemas with the specs from json-values. Leveraging the simplicity and composability of creating specs allows you to efficiently define Avro schemas. The provided serializers/deserializers enable the transmission of the immutable and persistent JSON from json-values through the wire in Avro format

avro avro-schema confluent confluent-schema-registry java json json-values kafka kafka-deserializer kafka-serializer persistent-data-structure

Last synced: 15 Apr 2025

https://github.com/confluentinc/data-mesh-demo

A Data Mesh proof-of-concept built on Confluent Cloud

cloud confluent confluent-cloud data-mesh kafka

Last synced: 27 Apr 2025

https://github.com/pluralsight/hydra-avro-utils

A collection of Avro utilities to facilitate the handling of streams containg Avro messages.

avro avro-messages avro-utilities confluent hydra kafka scala stream swift

Last synced: 04 Mar 2025

https://github.com/schm1tz1/confluentplatformdocker

Quickstart for local ConfluentPlatform on Docker with some useful scripts

confluent docker kafka platform quickstart zookeeper

Last synced: 03 Mar 2025

https://github.com/anant/playbook

Anant Platform Playbook - Consists of principles, patterns, tools, a framework, and an approach to designing, building, and managing plaforms.

approach cassandra confluent datastax framework kafka platform playbook spark

Last synced: 12 Mar 2025

https://github.com/tillkuhn/rubin

💿 rubin - a simple record producer for Kafka topics written in Go that acts as a thin wrapper around Confluent's REST Proxy API (v3)

cli cloudevents confluent go golang golang-library http-client kafka kafka-client kafka-go producer rest-api

Last synced: 25 Feb 2025

https://github.com/schroedermatt/stream-processing-workshop

Workshop driven from https://github.com/schroedermatt/data-demo

confluent confluent-cloud java kafka kafka-streams

Last synced: 12 Apr 2025

https://github.com/vise890/zookareg

Embedded Zookeeper Kafka and Confluent's Schema Registry.

confluent kafka testing tools zookeeper

Last synced: 21 Mar 2025

https://github.com/j3-signalroom/ccaf-housekeeping-python_lib

The CCAF Housekeeping Python Library is a CI/CD support tool designed to automate the teardown of a Flink table and its associated Kafka resources—such as topics and schemas—along with any long-running statements linked to it.

apache-flink confluent confluent-flink confluent-kafka confluent-schema-registry kafka

Last synced: 12 Mar 2025

https://github.com/ballerina-platform/module-ballerinax-confluent.cregistry

The Ballerina Avro Ser/Des package for Confluent provides APIs which will hide the complexities in serializing and deserializing data using Avro schemas along with the registration and retrieval of these schemas from the schema registry

avro ballerina confluent integration schema-registry

Last synced: 23 Mar 2025

https://github.com/jcustenborder/chef-confluent

Chef cookbook for the Confluent Platform

chef-recipes confluent kafka kafka-connect schema-registry

Last synced: 11 Mar 2025

https://github.com/pierrekieffer/docker-kafka-cluster

a Kafka multinode cluster deployed with docker-compose

confluent confluent-kafka docker docker-compose kafka

Last synced: 31 Mar 2025

https://github.com/oracle-quickstart/oke-confluent

Describes how to use Confluent on Oracle Kubernetes Engine (OKE)

cloud confluent containers docker kafka kubernetes oci oke partner-led

Last synced: 13 Apr 2025

https://github.com/unexist/showcase-asciidoc-extensions

Showcase for Asciidoc extensions [MIRROR]

asciidoc confluent maven plantuml ruby

Last synced: 01 Apr 2025

https://github.com/ctrl-hub/franz

Prometheus exporter for Kafka metrics, with a focus on Confluent Cloud

confluent confluent-kafka golang kafka prometheus

Last synced: 18 Mar 2025

https://github.com/andrewjbateman/node-kafka-webhooks

:clipboard: Work in progress: Kafka client KafkaJS used to interract with Confluent Cloud

confluent confluent-cloud kafka kafka-streams nodejs

Last synced: 18 Feb 2025

https://github.com/hifly81/kafka-spring-demo

Examples with spring kafka

confluent deadletter dlt kafka spring-kafka

Last synced: 07 Apr 2025

https://github.com/kavimaluskam/kafka-kubernetes

Kafka on docker-compose / Kubernetes powered by Confluent.io and Lenses.io

charts confluent helm-charts kafka kubernetes msk

Last synced: 07 Apr 2025

https://github.com/nryanov/avromirrormaker

AvroMirrorMaker allows you to replicate data from topics which use different schema registry provider

avro confluent hortonworks java kafka mirrormaker schema-registry

Last synced: 07 Apr 2025

https://github.com/sofyan48/confluent-example

Kafka with confluent sdk example

confluent example golang kafka

Last synced: 24 Mar 2025

https://github.com/chrisammon3000/building-data-pipelines-with-apache-kafka

Code & AWS deployment for the Confluent Developer course "Building Data Pipelines with Apache Kafka® and Confluent | Data Pipelines Tutorials"

aws cdk confluent ec2 kafka rds

Last synced: 16 Mar 2025

https://github.com/randsw/schema-registry-operator-strimzi

Confluent Schema Registry Operator for working with a Kafka cluster deployed using Strimzi Operator

confluent confluent-schema-registry golang helm helm-chart kafka kubebuilder kubernetes kubernetes-operator operator operator-sdk schema-registry

Last synced: 25 Mar 2025

https://github.com/filsan95/project-iot_malware_identification

This repository contains the code and data for a project that detects malware from IoT devices using a publish-subscribe model with Confluent and Databricks. The project streams IoT device data to Kafka, analyzes it, and detects malware using machine learning models such as Random Forest and Gradient Boosted Trees.

apache-kafka classification confluent databricks machine-learning-algorithms scikit-learn sql

Last synced: 16 Mar 2025

https://github.com/eng-gabrielscardoso/exchange-core

This project is the core of Exchange developed during Full Cycle immersion for learning purposes. This Exchange uses Golang for multithreading processing of trades and Apache Kafka as Broker.

apache-kafka apache-zookeeper confluent confluent-control-center confluent-kafka docker docker-compose go golang kafka zookeeper

Last synced: 28 Feb 2025

https://github.com/stefanoschrs/microservices-apache-kafka---confluent-webinar

Microservices & Apache-Kafka - Webinar by Confluent

confluent kafka microservices

Last synced: 16 Mar 2025

https://github.com/donaldkellett/kafka-streams-101

My adaptation of the hands-on exercises in the Confluent Developer Kafka Streams 101 course

confluent java kafka streams-api

Last synced: 20 Feb 2025

https://github.com/flauzo/notas-fiscais-integra-via-api

Sistema responsável por receber Notas Fiscais e seus dados de Pagamento, a partir de integração com ERP (Enterprise Resource Planning) de cliente.

avro conduktor confluent docker git hibernate jakarta java-17 junit kafka lombok maven pdf postgresql spring-boot spring-cloud spring-data-jpa spring-framework spring-mvc swagger-openapi

Last synced: 17 Mar 2025

https://github.com/kieranbond/basickafka

Super basic Kafka console application

confluent dotnet kafka

Last synced: 26 Mar 2025

https://github.com/mosheblumbergx/ansibleasdocker

Ansible Docker file to be used with Confluent cp-ansible

ansible confluent cp-ansible

Last synced: 18 Mar 2025

https://github.com/schm1tz1/kstreamsfilterapp

Example KStreams Filter App with configurable filtering for JSON objects, i.e. forward/drop objects in case a configured field in the payload matches a specific pattern

confluent filter json kafka kafka-streams papi

Last synced: 03 Mar 2025

https://github.com/sshaaf/flink-quarkus-demo

A short demo on how to use Apache Kafka, Avro, Flink on Confluent cloud

avro confluent flink java kafka quarkus

Last synced: 27 Mar 2025

https://github.com/victorhsr/spring-kafka-streams-101

Non-official repository with sample implementations of the Confluent's Kafka Streams 101 course.

confluent confluent-kafka container kafka spring stream test

Last synced: 02 Mar 2025

https://github.com/kvanzuijlen/confluent-gcs-sink-connector

Official confluent apache sink connector for Google Cloud Storage packaged in an Docker image

confluent docker kafka

Last synced: 17 Mar 2025