https://github.com/sai-mohan-b/footballdataengineering
An end-to-end data engineering pipeline that fetches data from Wikipedia, cleans and transforms it with Apache Airflow and saves it on Azure Data Lake. Other processing takes place on Azure Data Factory, Azure Synapse and Tableau.
https://github.com/sai-mohan-b/footballdataengineering
adf azure azure-storage azuredatalakegen2
Last synced: about 1 month ago
JSON representation
An end-to-end data engineering pipeline that fetches data from Wikipedia, cleans and transforms it with Apache Airflow and saves it on Azure Data Lake. Other processing takes place on Azure Data Factory, Azure Synapse and Tableau.
- Host: GitHub
- URL: https://github.com/sai-mohan-b/footballdataengineering
- Owner: SAI-MOHAN-B
- Created: 2024-08-29T12:33:48.000Z (almost 2 years ago)
- Default Branch: main
- Last Pushed: 2024-08-29T12:48:03.000Z (almost 2 years ago)
- Last Synced: 2025-01-29T15:11:59.904Z (over 1 year ago)
- Topics: adf, azure, azure-storage, azuredatalakegen2
- Language: Python
- Homepage:
- Size: 175 KB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0