https://github.com/voytasgit/kafkaconsumerservice

A lightweight, unofficial .NET-based Kafka consumer service designed to migrate legacy databases, enabling the current (live) database to be mirrored in a test or development environment by converting CRUD transactions into events.
https://github.com/voytasgit/kafkaconsumerservice

dotnet-core kafka microservice migration

Last synced: 10 months ago
JSON representation

A lightweight, unofficial .NET-based Kafka consumer service designed to migrate legacy databases, enabling the current (live) database to be mirrored in a test or development environment by converting CRUD transactions into events.

• Host: GitHub
• URL: https://github.com/voytasgit/kafkaconsumerservice
• Owner: voytasgit
• License: mit
• Created: 2025-05-09T06:42:18.000Z (11 months ago)
• Default Branch: main
• Last Pushed: 2025-06-02T08:15:07.000Z (10 months ago)
• Last Synced: 2025-06-15T06:05:41.651Z (10 months ago)
• Topics: dotnet-core, kafka, microservice, migration
• Language: C#
• Homepage:
• Size: 45 MB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

          
## Legal Notice

This project includes a Kafka consumer implementation intended to work with Apache Kafka.

It is an **unofficial** tool and is **not affiliated with, endorsed by, or supported by the Apache Software Foundation**.

"Apache", "Kafka", and related marks are trademarks of the Apache Software Foundation.

# KafkaConsumerService

KafkaConsumerService is a .NET 9 microservice that acts as a Kafka consumer. It listens to a Kafka topic, processes messages asynchronously via a decoupled message handler architecture, and persists or acts on the data using a generic repository.

The project includes:

⚙️ A Kafka consumer implemented as a hosted background service

📤 Outbox-driven Kafka producer for event publishing

🗃️ Message handling using a Strategy/Handler pattern

🧪 Testable structure with interface-based abstractions and JSON source generation

🧱 Includes SQL Server trigger-based change tracking

Use Case:

Ideal for .NET & Kafka-based event-driven systems. 

Especially useful when migrating from legacy databases, allowing the current (live) database to be mirrored into a test or development environment by transforming CRUD transactions into events. 

This is demonstrated using the example of the DISTLIST table.

Supports AOT-friendly JSON (via System.Text.Json source generators)

## Disclaimer

This software is provided "as is", without warranty of any kind.  

Use it at your own risk. The maintainers and contributors are not responsible for any damage or data loss resulting from its use.