An open API service indexing awesome lists of open source software.

https://github.com/pneff93/stream-processing-playground

Repo to try out different stream processing technologies
https://github.com/pneff93/stream-processing-playground

confluent-cloud flink-sql ksqldb kstreams

Last synced: about 1 month ago
JSON representation

Repo to try out different stream processing technologies

Awesome Lists containing this project

README

          

# Stream Processing Playground

This repository showcases different approaches to stream processing, focusing on **data transformation**, **wrangling**, and **aggregation**.
using the following tools:
- [Kafka Streams (KStreams)](https://kafka.apache.org/documentation/streams/)
- [ksqlDB](https://ksqldb.io/)
- [Confluent FlinkSQL](https://docs.confluent.io/cloud/current/flink/index.html)
- [Streamiz](https://github.com/LGouellec/streamiz)

![](image.png)

## Run on Confluent Cloud

We run the stream processing pipeline on Confluent Cloud (CC).

To get started, you'll need to provide the necessary configurations (like bootstrap server, API keys, etc.) in your applications. Once that's set up, you can launch the Kafka Producer and Kafka Streams by running
```
./gradlew run
```