https://github.com/essien1990/etl_pipeline_airflow

Creating pipelines using Python3 and Apache Airflow to load tables into Google Big Query Dataware House
https://github.com/essien1990/etl_pipeline_airflow

airflow airflow-dags airflow-operators bash bigquery bq datawarehouse etl-pipeline python3

Last synced: 7 months ago
JSON representation

Creating pipelines using Python3 and Apache Airflow to load tables into Google Big Query Dataware House

• Host: GitHub
• URL: https://github.com/essien1990/etl_pipeline_airflow
• Owner: essien1990
• Created: 2021-11-06T02:57:18.000Z (almost 4 years ago)
• Default Branch: main
• Last Pushed: 2021-11-06T03:05:21.000Z (almost 4 years ago)
• Last Synced: 2025-01-21T22:10:26.666Z (9 months ago)
• Topics: airflow, airflow-dags, airflow-operators, bash, bigquery, bq, datawarehouse, etl-pipeline, python3
• Language: Python
• Homepage:
• Size: 3.91 KB
• Stars: 1
• Watchers: 2
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

          
# ETL Pipeline Using Python3 & Airflow

Creating pipelines using Python3 and Apache Airflow to load tables into Google Big Query Dataware House

# Task

Create an ETL pipeline to Load tables into an existing dataset via Google Bigquery dataware house

# Technologies

  - Apache Airflow

      - bashOperator

      - dummyOperator

      - BigQueryOperator

  

  - Python3

  - Google Bigquery Dataware House