Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/janaom/gcp-de-project-streaming-pubsub-beam-dataflow
This project demonstrates an end-to-end solution for processing and analyzing real-time conversations data from a JSON file using GCP services and infrastructure automation, showcasing data storage, streaming, processing, and analysis at scale.
https://github.com/janaom/gcp-de-project-streaming-pubsub-beam-dataflow
apache-beam bigquery dataflow de-project gcp pubsub streaming-data
Last synced: about 1 month ago
JSON representation
This project demonstrates an end-to-end solution for processing and analyzing real-time conversations data from a JSON file using GCP services and infrastructure automation, showcasing data storage, streaming, processing, and analysis at scale.
- Host: GitHub
- URL: https://github.com/janaom/gcp-de-project-streaming-pubsub-beam-dataflow
- Owner: janaom
- Created: 2024-04-07T15:49:34.000Z (9 months ago)
- Default Branch: main
- Last Pushed: 2024-04-29T16:40:46.000Z (8 months ago)
- Last Synced: 2024-04-29T19:03:54.574Z (8 months ago)
- Topics: apache-beam, bigquery, dataflow, de-project, gcp, pubsub, streaming-data
- Language: Python
- Homepage:
- Size: 172 KB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0