https://github.com/engraulleite/local-data-warehousing-with-docker
Creating a DW from 0 to hero. Starting with logical and physical modeling to valuable reports.
https://github.com/engraulleite/local-data-warehousing-with-docker
airbyte data-analysis datawarehouse docker etl-pipeline metabase pgadmin4 postgresql
Last synced: about 1 month ago
JSON representation
Creating a DW from 0 to hero. Starting with logical and physical modeling to valuable reports.
- Host: GitHub
- URL: https://github.com/engraulleite/local-data-warehousing-with-docker
- Owner: engraulleite
- Created: 2023-09-01T19:30:05.000Z (almost 3 years ago)
- Default Branch: main
- Last Pushed: 2023-09-04T16:34:50.000Z (almost 3 years ago)
- Last Synced: 2023-09-05T03:28:09.918Z (almost 3 years ago)
- Topics: airbyte, data-analysis, datawarehouse, docker, etl-pipeline, metabase, pgadmin4, postgresql
- Homepage:
- Size: 1.45 MB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# Local-Data-Warehousing-with-Docker
Creating a DW from zero to hero. Starting with logical and physical modeling to valuable reports.
## Services provided:
- [x] Business case analysis
- [x] Logical and physical model creation
- [x] Choosing the best architecture for data ETL
- [x] Creating source data for analysis
- [x] Data ingestion using Airbyte
- [x] Use of Staging Area for cleaning and transformations
- [x] Ingestion of transformed data into the data warehouse
- [x] Data warehouse analysis using Metabase
## Developed Skills:
- [x] PostgreSQL
- [x] PgAdmin
- [x] Docker
- [x] Airbyte
- [x] Metabase
## Architecture Diagram:
I made this diagram using [Diagrams.net](https://app.diagrams.net/)