https://github.com/ololx/deduplication-service-example
Java-based service for message deduplication from Kafka. It utilizes rocksDB to store checksum data of previously processed messages, ensuring reliable duplicate detection and preventing redundant processing of the same messages.
https://github.com/ololx/deduplication-service-example
Last synced: 4 months ago
JSON representation
Java-based service for message deduplication from Kafka. It utilizes rocksDB to store checksum data of previously processed messages, ensuring reliable duplicate detection and preventing redundant processing of the same messages.
- Host: GitHub
- URL: https://github.com/ololx/deduplication-service-example
- Owner: ololx
- License: mit
- Created: 2023-05-27T09:36:11.000Z (over 2 years ago)
- Default Branch: main
- Last Pushed: 2023-07-22T15:34:25.000Z (about 2 years ago)
- Last Synced: 2025-05-19T07:08:18.455Z (5 months ago)
- Language: Java
- Size: 24.4 KB
- Stars: 2
- Watchers: 2
- Forks: 1
- Open Issues: 0