https://github.com/gordonmurray/warpstream_debezium

Using Debezium with WarpStream as a Kafka alternative for CDC
https://github.com/gordonmurray/warpstream_debezium

debezium kafka sasl warpstream

Last synced: 30 days ago
JSON representation

Using Debezium with WarpStream as a Kafka alternative for CDC

• Host: GitHub
• URL: https://github.com/gordonmurray/warpstream_debezium
• Owner: gordonmurray
• License: mit
• Created: 2023-08-13T10:17:45.000Z (over 1 year ago)
• Default Branch: main
• Last Pushed: 2024-03-25T10:10:23.000Z (9 months ago)
• Last Synced: 2024-11-30T08:42:40.162Z (about 1 month ago)
• Topics: debezium, kafka, sasl, warpstream
• Homepage:
• Size: 60.4 MB
• Stars: 19
• Watchers: 3
• Forks: 1
• Open Issues: 0
• Metadata Files:
  • Readme: readme.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# CDC from MariaDB using Debezium and WarpStream

Trying out WarpStream as a Kafka alternative with Debezium.

### Insecure connection

Make an insecure connection from Debezium to [WarpStream using plain text](/insecure/)

### Secure connection

Make a secure connection from Debezium to [WarpStream Serverless - using SASL](./sasl/)

### Apicurio Schema registry

Connect Debezium to WarpStream using [Avro serialization and Apicurio schema registry](/insecure_schema_registry/)

### Sink data to S3 using Parquet format

Connect Debezium securely to WarpStream using Avro serialization and [sink the data to S3 in Parquet format](/secure_s3_sink)

---

In each folder, an example docker-compose.yml file is provided that launches a mariadb and a debezium container.

A connector can then submitted to Debezium which will tell it to read from Mariadb and push events to WarpStream.

![Debezium and WarpStream](./images/debezium_warpstream.png)