Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/janaom/gcp-data-engineering-etl-with-composer-dataflow
This project leverages GCS, Composer, Dataflow, BigQuery, and Looker on Google Cloud Platform (GCP) to build a robust data engineering solution for processing, storing, and reporting daily transaction data in the online food delivery industry.
https://github.com/janaom/gcp-data-engineering-etl-with-composer-dataflow
airflow apache-beam cloud-composer cloud-storage data-engineering dataflow de-project gcp gcs looker
Last synced: about 1 month ago
JSON representation
This project leverages GCS, Composer, Dataflow, BigQuery, and Looker on Google Cloud Platform (GCP) to build a robust data engineering solution for processing, storing, and reporting daily transaction data in the online food delivery industry.
- Host: GitHub
- URL: https://github.com/janaom/gcp-data-engineering-etl-with-composer-dataflow
- Owner: janaom
- Created: 2023-12-02T19:01:38.000Z (about 1 year ago)
- Default Branch: main
- Last Pushed: 2023-12-12T16:13:18.000Z (about 1 year ago)
- Last Synced: 2023-12-12T19:06:18.375Z (about 1 year ago)
- Topics: airflow, apache-beam, cloud-composer, cloud-storage, data-engineering, dataflow, de-project, gcp, gcs, looker
- Language: Python
- Homepage:
- Size: 290 KB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0