https://github.com/desininja/airflow-project
end-to-end data processing pipeline using AWS Airflow (Managed Workflows for Apache Airflow, MWAA) and AWS EMR that triggers a Spark job to process mock food delivery data. The processed data will then be ingested into an Amazon Redshift warehouse for further analysis.
https://github.com/desininja/airflow-project
Last synced: 8 months ago
JSON representation
end-to-end data processing pipeline using AWS Airflow (Managed Workflows for Apache Airflow, MWAA) and AWS EMR that triggers a Spark job to process mock food delivery data. The processed data will then be ingested into an Amazon Redshift warehouse for further analysis.
- Host: GitHub
- URL: https://github.com/desininja/airflow-project
- Owner: desininja
- Created: 2024-04-09T19:40:30.000Z (over 1 year ago)
- Default Branch: main
- Last Pushed: 2024-04-21T10:56:01.000Z (over 1 year ago)
- Last Synced: 2025-01-02T21:17:05.870Z (9 months ago)
- Language: Python
- Size: 36.1 KB
- Stars: 0
- Watchers: 2
- Forks: 0
- Open Issues: 0
-
Metadata Files: