Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/iht/bigquery-dataflow-cdc-example
A Dataflow streaming pipeline written in Java, reading data from Pubsub and recovering the sessions from potentially unordered data, and upserting the session data into BigQuery with no duplicates
https://github.com/iht/bigquery-dataflow-cdc-example
apache-beam bigquery cdc dataflow google-cloud pubsub
Last synced: 4 days ago
JSON representation
A Dataflow streaming pipeline written in Java, reading data from Pubsub and recovering the sessions from potentially unordered data, and upserting the session data into BigQuery with no duplicates
- Host: GitHub
- URL: https://github.com/iht/bigquery-dataflow-cdc-example
- Owner: iht
- Created: 2024-12-16T11:50:12.000Z (17 days ago)
- Default Branch: main
- Last Pushed: 2024-12-28T17:29:39.000Z (5 days ago)
- Last Synced: 2024-12-28T18:24:20.413Z (5 days ago)
- Topics: apache-beam, bigquery, cdc, dataflow, google-cloud, pubsub
- Language: Java
- Homepage:
- Size: 109 KB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 1
-
Metadata Files: