https://github.com/databendcloud/debezium-server-databend

Consume debezium events to databend
https://github.com/databendcloud/debezium-server-databend

Last synced: 4 months ago
JSON representation

Consume debezium events to databend

• Host: GitHub
• URL: https://github.com/databendcloud/debezium-server-databend
• Owner: databendcloud
• License: apache-2.0
• Created: 2023-06-29T09:17:30.000Z (almost 3 years ago)
• Default Branch: main
• Last Pushed: 2024-04-07T13:47:03.000Z (about 2 years ago)
• Last Synced: 2024-04-07T14:39:57.039Z (about 2 years ago)
• Language: Java
• Size: 173 KB
• Stars: 15
• Watchers: 5
• Forks: 1
• Open Issues: 2
• Metadata Files:
  • Readme: README.md
  • Contributing: CONTRIBUTING.md
  • License: LICENSE

Awesome Lists containing this project

README

          
# debezium-server-databend

This project could be used to receive database CDC changes from debezium server and send it to [databend](https://github.com/datafuselabs/databend) table.It's in realtime and  started independently without the need for auxiliary streaming platforms such as Kafka, Flink and Spark. 

# debezium databend consumer

The detail introduction docs available in [docs page](./docs/docs.md)

# Install from source

- Requirements:

    - JDK 11

    - Maven

- Clone from repo: `git clone https://github.com/databendcloud/debezium-server-databend.git`

- From the root of the project:

    - Build and package debezium server: `mvn -Passembly -Dmaven.test.skip package`

    - After building, unzip your server

      distribution: `unzip debezium-server-databend-dist/target/debezium-server-databend-dist*.zip -d databendDist`

    - cd into unzipped folder: `cd databendDist`

    - Create `application.properties` file and config it: `nano conf/application.properties`, you can check the example

      configuration

      in [application.properties.example](debezium-server-databend-sink/src/main/resources/conf/application.properties.example)

    - Run the server using provided script: `bash run.sh`

    - The debezium server with databend will be started

# Install from release

- Download zip file from [release](https://github.com/databendcloud/debezium-server-databend/releases)

- Unzip it

- Create `application.properties` file and config it: `nano conf/application.properties`, you can check the example

    configuration

    in [application.properties.example](debezium-server-databend-sink/src/main/resources/conf/application.properties.example)

- Run the server using provided script: `bash run.sh`

- The debezium server with databend will be started

# Contributing

You are warmly welcome to hack on debezium-server-databend. We have prepared a guide [CONTRIBUTING.md](./CONTRIBUTING.md).