Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/rozek1997/aviation-warehouse

Warehouse project for aviation data from 2019 in USA. ETL process, analyze using OLAP cube, data displayed with PowerBI
https://github.com/rozek1997/aviation-warehouse

data-warehouse microsoft-power-bi olap-cube sql-server ssas-multidimensional ssis stage-model

Last synced: 18 days ago
JSON representation

Warehouse project for aviation data from 2019 in USA. ETL process, analyze using OLAP cube, data displayed with PowerBI

Awesome Lists containing this project

README

        

Airport Data Warehouse project


Tools used



  • SAP Power Designer - to model the stage and main repository area

  • MS SQL Server 2017

  • Visual Studio 2017 with the addition of SQL Server Integration Services (SSIS) - to administer the ETL process and perform component procedures

  • Visual Studio 2017 with SQL Server Analysis Services (SSAS)

  • Miscrosoft Power BI - for business analysis


Brief description


The project consisted in designing a data warehouse for flights in the USA in 2019.
The source of the facts:


The project consisted of several stages. The individual stages consisted of:

  1. Proceed with loading data from .csv files to the stage
  2. area
  3. Please conduct the ETL process. This process was performed using component procedures that cleaned and then loaded data into the dimension tables of the main repository

  4. The next step was to load the data into the facts table, where a single flight was taken as a fact. In the fact table, the dimensional data was replaced by the data from lookup
  5. tables.
  6. For the main repository area, you had to create an OLAP cube using the Visual Studio tool with SQL Server Analysis Services (SSAS)
  7. .
  8. The last step was to execute reports in Microsoft Power BI using the executed OLAP
  9. cube.

Models of the stage area and the main reportment area


Model stage

![Stage model](Screeny/model_STAGE.PNG)

Model main repo

![Stage model](Screeny/model_HD.PNG)

Additional information


In the Scripts folder there are scripts containing procedures needed for the ETL process to work


In the Models folder you will find the Models modeled in Power Design-er together with the generated scripts that create specific databases of the data warehouse

.