https://github.com/msergo/flink-rabbitmq-source-boilerplate

A boilerplate for Flink-based projects with RabbitMQ included
https://github.com/msergo/flink-rabbitmq-source-boilerplate

Last synced: about 2 months ago
JSON representation

A boilerplate for Flink-based projects with RabbitMQ included

• Host: GitHub
• URL: https://github.com/msergo/flink-rabbitmq-source-boilerplate
• Owner: msergo
• Created: 2024-06-18T14:50:00.000Z (6 months ago)
• Default Branch: master
• Last Pushed: 2024-11-05T00:15:47.000Z (about 2 months ago)
• Last Synced: 2024-11-05T01:19:59.717Z (about 2 months ago)
• Language: Java
• Size: 28.3 KB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.org

Awesome Lists containing this project

README

        
[[file:https://github.com/msergo/flink-rabbitmq-source-boilerplate/actions/workflows/maven.yml/badge.svg][Build Status]]

* Description

A boilerplate for Flink-based projects which contains some useful pieces of code.

The main functionality of the boilerplate is to consume orders from a queue, group them by id in a session window and print the latest result.

* What's inside

- Consuming from RabbitMQ with custom deserialization

- Custom watermark generator (advance a watermark if no events for 5s)

- Simple flat function implementation

- Postgres sink

* Requirements for the project

- Java 11 (tested w/ Amazon Correto SDK)

- If you're using IntelliJ IDEA go to Run/Debug configuration -> Modify options -> check "Add dependencies with 'provided' scope..."

- RabbitMQ up and running

- Postgres up and running