Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/rozek1997/aviation-warehouse
Warehouse project for aviation data from 2019 in USA. ETL process, analyze using OLAP cube, data displayed with PowerBI
https://github.com/rozek1997/aviation-warehouse
data-warehouse microsoft-power-bi olap-cube sql-server ssas-multidimensional ssis stage-model
Last synced: 18 days ago
JSON representation
Warehouse project for aviation data from 2019 in USA. ETL process, analyze using OLAP cube, data displayed with PowerBI
- Host: GitHub
- URL: https://github.com/rozek1997/aviation-warehouse
- Owner: rozek1997
- Created: 2019-12-04T21:10:50.000Z (about 5 years ago)
- Default Branch: master
- Last Pushed: 2020-03-17T15:52:50.000Z (almost 5 years ago)
- Last Synced: 2024-11-17T11:56:01.547Z (3 months ago)
- Topics: data-warehouse, microsoft-power-bi, olap-cube, sql-server, ssas-multidimensional, ssis, stage-model
- Language: TSQL
- Homepage:
- Size: 18.2 MB
- Stars: 2
- Watchers: 1
- Forks: 1
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
Airport Data Warehouse project
Tools used
- SAP Power Designer - to model the stage and main repository area
- MS SQL Server 2017
- Visual Studio 2017 with the addition of SQL Server Integration Services (SSIS) - to administer the ETL process and perform component procedures
- Visual Studio 2017 with SQL Server Analysis Services (SSAS)
- Miscrosoft Power BI - for business analysis
Brief description
The project consisted in designing a data warehouse for flights in the USA in 2019.
The source of the facts:
The project consisted of several stages. The individual stages consisted of:
- Proceed with loading data from .csv files to the stage area
- Please conduct the ETL process. This process was performed using component procedures that cleaned and then loaded data into the dimension tables of the main repository
- The next step was to load the data into the facts table, where a single flight was taken as a fact. In the fact table, the dimensional data was replaced by the data from lookup tables.
- For the main repository area, you had to create an OLAP cube using the Visual Studio tool with SQL Server Analysis Services (SSAS) .
- The last step was to execute reports in Microsoft Power BI using the executed OLAP cube.
Models of the stage area and the main reportment area
Model stage
![Stage model](Screeny/model_STAGE.PNG)
Model main repo
![Stage model](Screeny/model_HD.PNG)
Additional information
In the Scripts folder there are scripts containing procedures needed for the ETL process to work
In the Models folder you will find the Models modeled in Power Design-er together with the generated scripts that create specific databases of the data warehouse
.