Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/carakawedhatama/go-cdc
A sample of CDC process using Golang
https://github.com/carakawedhatama/go-cdc
change-data-capture debezium golang kafka kafka-connect mariadb
Last synced: about 1 month ago
JSON representation
A sample of CDC process using Golang
- Host: GitHub
- URL: https://github.com/carakawedhatama/go-cdc
- Owner: carakawedhatama
- License: mit
- Created: 2024-06-09T21:06:13.000Z (8 months ago)
- Default Branch: main
- Last Pushed: 2024-06-09T21:34:52.000Z (8 months ago)
- Last Synced: 2024-11-08T04:44:28.849Z (3 months ago)
- Topics: change-data-capture, debezium, golang, kafka, kafka-connect, mariadb
- Language: Go
- Homepage:
- Size: 9.77 KB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# go-cdc
This repository demonstrates how to use Change Data Capture (CDC) with Debezium, Kafka, and Go.
Inspired by [this video](https://www.youtube.com/watch?v=5ETH7ENJ-Vs&ab_channel=ProgrammerZamanNow), thanks to [Eko Kurniawan Khannedy](https://www.linkedin.com/in/khannedy/) 🎉.## Prerequisites
- Docker
- Docker Compose
- Go## Setup
1. Clone this repository:
```bash
git clone https://github.com/carakawedhatama/go-cdc.git
cd go-cdc
```2. Start the services using Docker Compose:
```bash
docker-compose up -d
```3. Run the Go application:
```bash
go mod tidy
go run main.go
```## How it works?
- MariaDB is set up with a sample database and table.
- Debezium captures changes from the MariaDB transaction log and sends them to Kafka.
- The Go-CDC application consumes the changes from the Kafka topic and prints them.## License
This project is licensed under the MIT License.