https://github.com/memiiso/debezium-server-iceberg

Low Cost, Simple and Scalable Way of Data Replication to Apache Iceberg/Cloud/Data Lake
https://github.com/memiiso/debezium-server-iceberg

batch cdc debezium iceberg iceberg-table realtime

Last synced: 4 months ago
JSON representation

Low Cost, Simple and Scalable Way of Data Replication to Apache Iceberg/Cloud/Data Lake

• Host: GitHub
• URL: https://github.com/memiiso/debezium-server-iceberg
• Owner: memiiso
• License: apache-2.0
• Created: 2021-01-17T22:16:13.000Z (over 5 years ago)
• Default Branch: master
• Last Pushed: 2025-10-18T09:32:40.000Z (8 months ago)
• Last Synced: 2025-10-19T05:52:21.016Z (8 months ago)
• Topics: batch, cdc, debezium, iceberg, iceberg-table, realtime
• Language: Java
• Homepage: https://memiiso.github.io/debezium-server-iceberg/
• Size: 2.72 MB
• Stars: 286
• Watchers: 8
• Forks: 59
• Open Issues: 14
• Metadata Files:
  • Readme: README.md
  • Contributing: docs/contributing.md
  • License: LICENSE

Awesome Lists containing this project

README

          
[![License](http://img.shields.io/:license-apache%202.0-brightgreen.svg)](http://www.apache.org/licenses/LICENSE-2.0.html)

![contributions welcome](https://img.shields.io/badge/contributions-welcome-brightgreen.svg?style=flat)

![Create Release](https://github.com/memiiso/debezium-server-iceberg/actions/workflows/release.yml/badge.svg)

# Debezium Iceberg Consumer

This project implements Debezium Server Iceberg consumer

see [Debezium Server](https://debezium.io/documentation/reference/operations/debezium-server.html). It enables real-time

replication of Change Data Capture (CDC) events from any database to Iceberg tables. Without requiring Spark, Kafka or

Streaming platform in between.

See the [Documentation Page](https://memiiso.github.io/debezium-server-iceberg/) for more details.

![Debezium Iceberg](https://raw.githubusercontent.com/memiiso/debezium-server-iceberg/master/docs/images/debezium-iceberg-architecture.drawio.png)

## Installation

- Requirements:

  - JDK 21

  - Maven

### Building from source code

```bash

git clone https://github.com/memiiso/debezium-server-iceberg.git

cd debezium-server-iceberg

mvn -Passembly -Dmaven.test.skip package

# unzip and run the application

unzip debezium-server-iceberg-dist/target/debezium-server-iceberg-dist*.zip -d appdist

cd appdist/debezium-server-iceberg

mv config/application.properties.example config/application.properties

bash run.sh

```

## Contributing

The Memiiso community welcomes anyone that wants to help out in any way, whether that includes reporting problems,

helping with documentation, or contributing code changes to fix bugs, add tests, or implement new features.

See [contributing document](docs/contributing.md) for details.

### Contributors