https://github.com/pwenker/data-engineering

My notes for Udacity's Data Engineering Nanodegree.
https://github.com/pwenker/data-engineering

data-engineer data-engineering quiz udacity udacity-nanodegree

Last synced: 6 months ago
JSON representation

My notes for Udacity's Data Engineering Nanodegree.

• Host: GitHub
• URL: https://github.com/pwenker/data-engineering
• Owner: pwenker
• Created: 2021-12-10T15:49:19.000Z (about 4 years ago)
• Default Branch: main
• Last Pushed: 2021-12-10T15:58:48.000Z (about 4 years ago)
• Last Synced: 2025-02-14T18:59:01.919Z (12 months ago)
• Topics: data-engineer, data-engineering, quiz, udacity, udacity-nanodegree
• Homepage: https://pwenker.github.io/data-engineering/
• Size: 1.3 MB
• Stars: 5
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: readme.md

Awesome Lists containing this project

README

          
## Data Engineering

[![Thumbnail](https://github.com/pwenker/data-engineering/blob/main/docs/images/demo.png?raw=true)](https://pwenker.github.io/data-engineering/)

|  | Data Engineering |

| --- | --- |

| Project                | [![GitHub Repo stars](https://img.shields.io/github/stars/pwenker/data-engineering?style=social)](https://github.com/pwenker/data-engineering) ![GitHub code size in bytes](https://img.shields.io/github/languages/code-size/pwenker/data-engineering) ![Lines of code](https://img.shields.io/tokei/lines/github/pwenker/data-engineering)

| Activity & Issue Tracking | ![GitHub last commit](https://img.shields.io/github/last-commit/pwenker/data-engineering) [![GitHub issues](https://img.shields.io/github/issues-raw/pwenker/data-engineering)](https://github.com/pwenker/data-engineering/issues?q=is%3Aopen+is%3Aissue) [![GitHub closed issues](https://img.shields.io/github/issues-closed-raw/pwenker/data-engineering)](https://github.com/pwenker/data-engineering/issues?q=is%3Aissue+is%3Aclosed)  |

| Docs | [![Documentation Status](https://img.shields.io/badge/Docs-index-green)](https://pwenker.com/data-engineering) [![Knowledge](https://img.shields.io/badge/Docs-knowledge-brightgreen)](https://pwenker.com/data-engineering/knowledge/)| 

| News & Updates | [![Twitter Follow](https://img.shields.io/twitter/follow/PascalWenker?style=social)](https://twitter.com/PascalWenker) [![GitHub followers](https://img.shields.io/github/followers/pwenker?style=social)](https://github.com/pwenker)|

### Purpose of this Project

- This repository contains my notes for [**Udacity's Data Engineering Nanodegree**](https://www.udacity.com/course/data-engineer-nanodegree--nd027) :rocket:

- The notes are represented in a *question-and-answer* format to allow for [active recall testing](https://en.wikipedia.org/wiki/Active_recall) :brain:

- If you have completed the degree yourself, you might be interested in testing your knowledge by trying to answer the questions. Regardless of your ability to answer the questions, and the

  quality of my written answers :sweat_smile:, the mere exposure and deliberate retrieval practice will help you consolidate your knowledge :exploding_head:

- Have fun!  :partying_face:

## Table of Contents

### Knowledge 

* [Data Engineering Nanodegree - Part 1 - Data Modeling](docs/knowledge/data_engineering_nanodegree_-_part_1_-_data_modeling.md#data-engineering-nanodegree---part-1---data-modeling)

   * [Data Engineering](docs/knowledge/data_engineering_nanodegree_-_part_1_-_data_modeling.md#data-engineering)

      * [Data Modeling](docs/knowledge/data_engineering_nanodegree_-_part_1_-_data_modeling.md#data-modeling)

         * [Module 1](docs/knowledge/data_engineering_nanodegree_-_part_1_-_data_modeling.md#module-1)

            * [Introduction To Data Modeling](docs/knowledge/data_engineering_nanodegree_-_part_1_-_data_modeling.md#introduction-to-data-modeling)

         * [Module 2](docs/knowledge/data_engineering_nanodegree_-_part_1_-_data_modeling.md#module-2)

            * [Relational Data Models](docs/knowledge/data_engineering_nanodegree_-_part_1_-_data_modeling.md#relational-data-models)

         * [Module 3](docs/knowledge/data_engineering_nanodegree_-_part_1_-_data_modeling.md#module-3)

            * [Nosql Data Models](docs/knowledge/data_engineering_nanodegree_-_part_1_-_data_modeling.md#nosql-data-models)

   * [Acronyms](docs/knowledge/data_engineering_nanodegree_-_part_1_-_data_modeling.md#acronyms)

* [Data Engineering Nanodegree - Part 2 - Cloud Data Warehouses](docs/knowledge/data_engineering_nanodegree_-_part_2_-_cloud_data_warehouses.md#data-engineering-nanodegree---part-2---cloud-data-warehouses)

   * [Data Engineering](docs/knowledge/data_engineering_nanodegree_-_part_2_-_cloud_data_warehouses.md#data-engineering)

      * [Cloud Data Warehouses](docs/knowledge/data_engineering_nanodegree_-_part_2_-_cloud_data_warehouses.md#cloud-data-warehouses)

         * [Module 1](docs/knowledge/data_engineering_nanodegree_-_part_2_-_cloud_data_warehouses.md#module-1)

            * [Introduction To Data Warehouses](docs/knowledge/data_engineering_nanodegree_-_part_2_-_cloud_data_warehouses.md#introduction-to-data-warehouses)

         * [Module 2](docs/knowledge/data_engineering_nanodegree_-_part_2_-_cloud_data_warehouses.md#module-2)

            * [Introduction To Cloud Computing And Aws](docs/knowledge/data_engineering_nanodegree_-_part_2_-_cloud_data_warehouses.md#introduction-to-cloud-computing-and-aws)

         * [Module 3](docs/knowledge/data_engineering_nanodegree_-_part_2_-_cloud_data_warehouses.md#module-3)

            * [Implementing Data Warehouses On Aws](docs/knowledge/data_engineering_nanodegree_-_part_2_-_cloud_data_warehouses.md#implementing-data-warehouses-on-aws)

   * [Acronyms](docs/knowledge/data_engineering_nanodegree_-_part_2_-_cloud_data_warehouses.md#acronyms)

* [Data Engineering Nanodegree - Part 3 - Data Lakes with Spark](docs/knowledge/data_engineering_nanodegree_-_part_3_-_data_lakes_with_spark.md#data-engineering-nanodegree---part-3---data-lakes-with-spark)

   * [Data Engineering](docs/knowledge/data_engineering_nanodegree_-_part_3_-_data_lakes_with_spark.md#data-engineering)

      * [Data Lakes With Spark](docs/knowledge/data_engineering_nanodegree_-_part_3_-_data_lakes_with_spark.md#data-lakes-with-spark)

         * [Module 4](docs/knowledge/data_engineering_nanodegree_-_part_3_-_data_lakes_with_spark.md#module-4)

            * [Data Wrangling With Spark](docs/knowledge/data_engineering_nanodegree_-_part_3_-_data_lakes_with_spark.md#data-wrangling-with-spark)

            * [The Power Of Spark](docs/knowledge/data_engineering_nanodegree_-_part_3_-_data_lakes_with_spark.md#the-power-of-spark)

         * [Module 5](docs/knowledge/data_engineering_nanodegree_-_part_3_-_data_lakes_with_spark.md#module-5)

            * [Introduction To Data Lakes](docs/knowledge/data_engineering_nanodegree_-_part_3_-_data_lakes_with_spark.md#introduction-to-data-lakes)

   * [Acronyms](docs/knowledge/data_engineering_nanodegree_-_part_3_-_data_lakes_with_spark.md#acronyms)

* [Data Engineering Nanodegree - Part 4 - Data Pipelines With Airflow](docs/knowledge/data_engineering_nanodegree_-_part_4_-_data_pipelines_with_airflow.md#data-engineering-nanodegree---part-4---data-pipelines-with-airflow)

   * [Data Engineering](docs/knowledge/data_engineering_nanodegree_-_part_4_-_data_pipelines_with_airflow.md#data-engineering)

      * [Data Pipelines With Airflow](docs/knowledge/data_engineering_nanodegree_-_part_4_-_data_pipelines_with_airflow.md#data-pipelines-with-airflow)

         * [Module 1](docs/knowledge/data_engineering_nanodegree_-_part_4_-_data_pipelines_with_airflow.md#module-1)

            * [Data Pipelines](docs/knowledge/data_engineering_nanodegree_-_part_4_-_data_pipelines_with_airflow.md#data-pipelines)

         * [Module 2](docs/knowledge/data_engineering_nanodegree_-_part_4_-_data_pipelines_with_airflow.md#module-2)

            * [Data Quality](docs/knowledge/data_engineering_nanodegree_-_part_4_-_data_pipelines_with_airflow.md#data-quality)

         * [Module 3](docs/knowledge/data_engineering_nanodegree_-_part_4_-_data_pipelines_with_airflow.md#module-3)

            * [Production Data Pipelines](docs/knowledge/data_engineering_nanodegree_-_part_4_-_data_pipelines_with_airflow.md#production-data-pipelines)

   * [Acronyms](docs/knowledge/data_engineering_nanodegree_-_part_4_-_data_pipelines_with_airflow.md#acronyms)