https://github.com/malek-logh/change-data-capture-cdc

This project demonstrates how to capture changes from a PostgreSQL database and stream them into Kafka using Debezium. It showcases a robust and scalable way to track and propagate data changes in real-time, ensuring your systems stay synchronized and up-to-date.
https://github.com/malek-logh/change-data-capture-cdc

cdc debezium docker kafka postgres zookeeper

Last synced: about 2 months ago
JSON representation

This project demonstrates how to capture changes from a PostgreSQL database and stream them into Kafka using Debezium. It showcases a robust and scalable way to track and propagate data changes in real-time, ensuring your systems stay synchronized and up-to-date.

• Host: GitHub
• URL: https://github.com/malek-logh/change-data-capture-cdc
• Owner: Malek-logh
• Created: 2024-06-30T02:47:37.000Z (7 months ago)
• Default Branch: main
• Last Pushed: 2024-06-30T03:00:35.000Z (7 months ago)
• Last Synced: 2024-06-30T22:16:21.755Z (7 months ago)
• Topics: cdc, debezium, docker, kafka, postgres, zookeeper
• Language: Python
• Homepage:
• Size: 56.6 KB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# Change-Data-Capture-CDC

This project demonstrates how to capture changes from a PostgreSQL database and stream them into Kafka using Debezium. It showcases a robust and scalable way to track and propagate data changes in real-time, ensuring your systems stay synchronized and up-to-date.

# Services in the Compose File

- **Zookeeper**: A centralized service for maintaining configuration information, managing naming, providing distributed synchronization, and offering group services.

- **Kafka Broker**: A distributed streaming platform used for handling real-time data feeds.

- **Confluent Control Center**: A web-based tool for managing and monitoring Apache Kafka.

- **Debezium**: An open-source distributed platform for change data capture.

- **Debezium UI**: A user interface for managing and monitoring Debezium connectors.

- **Postgres**: An open-source relational database.