https://github.com/AuFeld/Data_Engineering_Projects

A collection of data engineering projects: data modeling, ETL pipelines, data lakes, infrastructure configuration on AWS, data warehousing, containerization, and a dashboard to monitor data pipeline KPIs
https://github.com/AuFeld/Data_Engineering_Projects

airflow aws cassandra data-engineering data-lake data-warehouse docker emr etl-pipeline infrastructure-as-code infrastructure-setup postgresql python redshift s3 spark

Last synced: 3 months ago
JSON representation

A collection of data engineering projects: data modeling, ETL pipelines, data lakes, infrastructure configuration on AWS, data warehousing, containerization, and a dashboard to monitor data pipeline KPIs

• Host: GitHub
• URL: https://github.com/AuFeld/Data_Engineering_Projects
• Owner: AuFeld
• License: mit
• Created: 2021-04-09T11:36:52.000Z (over 3 years ago)
• Default Branch: main
• Last Pushed: 2021-04-29T14:56:43.000Z (over 3 years ago)
• Last Synced: 2024-05-28T04:54:34.864Z (5 months ago)
• Topics: airflow, aws, cassandra, data-engineering, data-lake, data-warehouse, docker, emr, etl-pipeline, infrastructure-as-code, infrastructure-setup, postgresql, python, redshift, s3, spark
• Language: Python
• Homepage: https://aufeld.github.io/2021-04-15-DataEngineering/
• Size: 316 MB
• Stars: 12
• Watchers: 3
• Forks: 1
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

• jimsghstars - AuFeld/Data_Engineering_Projects - A collection of data engineering projects: data modeling, ETL pipelines, data lakes, infrastructure configuration on AWS, data warehousing, containerization, and a dashboard to monitor data pipeline K (Python)