An open API service indexing awesome lists of open source software.

https://github.com/bhaveshharmalkar/sql-data-warehouse-project

Comprehensive data warehousing and analytics project, from building a data warehouse to generating actionable insights
https://github.com/bhaveshharmalkar/sql-data-warehouse-project

data-analysis data-analytics data-engineering data-science etl sql sqlserver

Last synced: about 1 hour ago
JSON representation

Comprehensive data warehousing and analytics project, from building a data warehouse to generating actionable insights

Awesome Lists containing this project

README

          

# Data Warehouse and Analytics Project

Welcome to the **Data Warehouse and Analytics Project** repository.
This project demonstrates a comprehensive data warehousing and analytics project, from building a data warehouse to generating actionable insights.

---

## 🏗️ Data Architecture
The data architecture for this project follows Medallion Architecture Bronze, Silver, and Gold layers

![Data Architecture](https://github.com/bhaveshharmalkar/sql-data-warehouse-project/blob/main/docs/data_architecture.png)

---

## 📖 Project Overview

Project Involves:
1. **Data Architecture**: Designing a Modern Data Warehouse Using Medallion Architecture Bronze, Silver, and Gold layers.
2. **ETL Pipelines**: Extracting, transforming, and loading data from source systems into the warehouse.
3. **Data Modeling**: Developing fact and dimension tables optimized for analytical queries.
4. **Analytics & Reporting**: Creating SQL-based reports and dashboards for actionable insights.

---

## 🚀 Project Requirement

### Building the Data Warehouse (Data Engineering)

**Objective**

Develop a modern data warehouse using SQL Server to consolidate sales data, enabling analytical reporting and informed decision-making.

**Specifications**
- **Data Sources**: Import data from two source systems (ERP and CRM) provided as CSV files.
- **Data Quality**: Cleanse and resolve data quality issues prior to analysis.
- **Integration**: Combine both sources into a single, user-friendly data model designed for analytical queries.
- **Scope**: Focus on the latest dataset only; historization of data is not required.
- **Documentation**: Provide clear documentation of the data model to support both business stakeholders and analytics teams.

---

### BI: Analytics & Reporting (Data Analysis)

**Objective**

Develop SQL-based analytics to deliver detailed insights into:

- **Customer Behavior**
- **Product Performance**
- **Sales Trends**

These insights empower stakeholders with key business metrics, enabling strategic decision-making.