https://github.com/charlesemil/sql-data-warehouse-project
Building a modern data warehouse with SQL Server, Including ETL processes, data modeling and analytics.
https://github.com/charlesemil/sql-data-warehouse-project
data-analytics data-cleaning data-engineer data-science data-warehouse data-warehousing datascience etl etl-pipeline medallion-architecture sql sql-query sql-server sqlserver
Last synced: 4 days ago
JSON representation
Building a modern data warehouse with SQL Server, Including ETL processes, data modeling and analytics.
- Host: GitHub
- URL: https://github.com/charlesemil/sql-data-warehouse-project
- Owner: CharlesEmil
- License: mit
- Created: 2025-02-04T15:50:31.000Z (8 months ago)
- Default Branch: main
- Last Pushed: 2025-03-01T08:57:36.000Z (7 months ago)
- Last Synced: 2025-03-01T09:25:36.519Z (7 months ago)
- Topics: data-analytics, data-cleaning, data-engineer, data-science, data-warehouse, data-warehousing, datascience, etl, etl-pipeline, medallion-architecture, sql, sql-query, sql-server, sqlserver
- Language: TSQL
- Homepage:
- Size: 1.53 MB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# Data Warehouse and Analytics Project
Welcome to the **Data Warehouse and Analytics Project** repository! 📊
This project demonstrates a comprehensive data warehousing and analytics solution, from building a data warehouse to generating actionable insights. Designed as a portfolio project, it highlights industry best practices in SQL and analytics.
---
## 🏗️ Data Architecture
The data architecture for this project follows Medallion Architecture **Bronze**, **Silver**, and **Gold** layers:
1. **Bronze Layer**: Stores raw data as-is from the source systems. Data is ingested from CSV Files into SQL Server Database.
2. **Silver Layer**: This layer includes data cleansing, standardization, and normalization processes to prepare data for analysis.
3. **Gold Layer**: Houses business-ready data modeled into a star schema required for reporting and analytics.
---
## 📖 Project Overview
This project involves:
1. **Data Architecture**: Designing a Modern Data Warehouse Using Medallion Architecture **Bronze**, **Silver**, and **Gold** layers.
2. **ETL Pipelines**: Extracting, transforming, and loading data from source systems into the warehouse.
3. **Data Modeling**: Developing fact and dimension tables optimized for analytical queries.
4. **Analytics & Reporting**: Creating SQL-based reports and dashboards for actionable insights.
---
## 🛠️ Important Tools used in the Project:
- **[Datasets](Datasets/):** Access to the project dataset (csv files).
- **[SQL Server Express](https://www.microsoft.com/en-us/sql-server/sql-server-downloads):** Lightweight server for hosting your SQL database.
- **[SQL Server Management Studio (SSMS)](https://learn.microsoft.com/en-us/sql/ssms/download-sql-server-management-studio-ssms?view=sql-server-ver16):** GUI for managing and interacting with databases.
- **[DrawIO](https://www.drawio.com/):** Design data architecture, models, flows, and diagrams.
- **[Notion Project Steps](https://clever-radio-aa9.notion.site/Data-Warehouse-Project-18f19c934bb4800da2f7cf781db308fe):** Access to All Project Phases and Tasks.
---
## 🚀 Project Requirements
### Building the Data Warehouse
#### Objective
Build a modern SQL Server data warehouse to centralize sales data, enabling analytical reporting and data-driven decision-making.
#### Specifications
- **Data Sources**: Import data from two source systems (ERP and CRM) provided as CSV files.
- **Data Quality**: Clean and resolve any data quality issues before analysis.
- **Integration**: Merge both sources into a single, structured data model optimized for analytical queries.
- **Scope**: Focus only on the latest dataset; historical data storage is not required.
- **Documentation**: Provide clear documentation of the data model to support both business stakeholders and analytics teams.
---
### BI: Analytics & Reporting
#### Objective
Develop SQL-based analytics to generate key business insights on:
- **Customer Behavior**
- **Product Performance**
- **Sales Trends**
🎯 These insights will provide stakeholders with essential metrics to drive strategic decision-making.
---
## 🛡️ License
This project is licensed under the [MIT License](LICENSE).
## 🌟 About Me
Hey there I'm **Charles-emil Fouché** ! Curently working as Sales Man. I’m on a mission to transition from Sales Man to Data Analyst !
Let's stay in touch! Feel free to connect with me:
[](https://www.linkedin.com/in/charles-emil-fouche/)