{"id":25853661,"url":"https://github.com/charlesemil/sql-data-warehouse-project","last_synced_at":"2025-10-05T12:15:38.101Z","repository":{"id":275794174,"uuid":"927219581","full_name":"CharlesEmil/sql-data-warehouse-project","owner":"CharlesEmil","description":"Building a modern data warehouse with SQL Server, Including ETL processes, data modeling and analytics.","archived":false,"fork":false,"pushed_at":"2025-03-01T08:57:36.000Z","size":1607,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-03-01T09:25:36.519Z","etag":null,"topics":["data-analytics","data-cleaning","data-engineer","data-science","data-warehouse","data-warehousing","datascience","etl","etl-pipeline","medallion-architecture","sql","sql-query","sql-server","sqlserver"],"latest_commit_sha":null,"homepage":"","language":"TSQL","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/CharlesEmil.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2025-02-04T15:50:31.000Z","updated_at":"2025-03-01T08:57:39.000Z","dependencies_parsed_at":"2025-02-04T16:39:22.318Z","dependency_job_id":"a9d62589-dbe5-4211-a3bb-a96bbd13a584","html_url":"https://github.com/CharlesEmil/sql-data-warehouse-project","commit_stats":null,"previous_names":["charlesemil/sql-data-warehouse-project"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/CharlesEmil%2Fsql-data-warehouse-project","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/CharlesEmil%2Fsql-data-warehouse-project/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/CharlesEmil%2Fsql-data-warehouse-project/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/CharlesEmil%2Fsql-data-warehouse-project/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/CharlesEmil","download_url":"https://codeload.github.com/CharlesEmil/sql-data-warehouse-project/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":241381711,"owners_count":19953764,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["data-analytics","data-cleaning","data-engineer","data-science","data-warehouse","data-warehousing","datascience","etl","etl-pipeline","medallion-architecture","sql","sql-query","sql-server","sqlserver"],"created_at":"2025-03-01T15:18:56.807Z","updated_at":"2025-10-05T12:15:38.094Z","avatar_url":"https://github.com/CharlesEmil.png","language":"TSQL","readme":"\n# Data Warehouse and Analytics Project\n\nWelcome to the **Data Warehouse and Analytics Project** repository! 📊\nThis project demonstrates a comprehensive data warehousing and analytics solution, from building a data warehouse to generating actionable insights. Designed as a portfolio project, it highlights industry best practices in SQL and analytics.\n\n---\n## 🏗️ Data Architecture\n\nThe data architecture for this project follows Medallion Architecture **Bronze**, **Silver**, and **Gold** layers:\n![Data Architecture drawio](https://github.com/user-attachments/assets/2599ad88-99a3-4acc-8e24-103837ae177c)\n\n\n1. **Bronze Layer**: Stores raw data as-is from the source systems. Data is ingested from CSV Files into SQL Server Database.\n2. **Silver Layer**: This layer includes data cleansing, standardization, and normalization processes to prepare data for analysis.\n3. **Gold Layer**: Houses business-ready data modeled into a star schema required for reporting and analytics.\n\n---\n## 📖 Project Overview\n\nThis project involves:\n\n1. **Data Architecture**: Designing a Modern Data Warehouse Using Medallion Architecture **Bronze**, **Silver**, and **Gold** layers.\n2. **ETL Pipelines**: Extracting, transforming, and loading data from source systems into the warehouse.\n3. **Data Modeling**: Developing fact and dimension tables optimized for analytical queries.\n4. **Analytics \u0026 Reporting**: Creating SQL-based reports and dashboards for actionable insights.\n\n---\n\n## 🛠️ Important Tools used in the Project:\n- **[Datasets](Datasets/):** Access to the project dataset (csv files). \n- **[SQL Server Express](https://www.microsoft.com/en-us/sql-server/sql-server-downloads):** Lightweight server for hosting your SQL database. \n- **[SQL Server Management Studio (SSMS)](https://learn.microsoft.com/en-us/sql/ssms/download-sql-server-management-studio-ssms?view=sql-server-ver16):** GUI for managing and interacting with databases.\n- **[DrawIO](https://www.drawio.com/):** Design data architecture, models, flows, and diagrams.\n- **[Notion Project Steps](https://clever-radio-aa9.notion.site/Data-Warehouse-Project-18f19c934bb4800da2f7cf781db308fe):** Access to All Project Phases and Tasks.\n\n\n---\n\n## 🚀 Project Requirements\n\n### Building the Data Warehouse \n\n#### Objective\nBuild a modern SQL Server data warehouse to centralize sales data, enabling analytical reporting and data-driven decision-making.\n\n#### Specifications\n- **Data Sources**: Import data from two source systems (ERP and CRM) provided as CSV files.\n- **Data Quality**: Clean and resolve any data quality issues before analysis.\n- **Integration**: Merge both sources into a single, structured data model optimized for analytical queries.\n- **Scope**: Focus only on the latest dataset; historical data storage is not required.\n- **Documentation**: Provide clear documentation of the data model to support both business stakeholders and analytics teams.\n---\n\n### BI: Analytics \u0026 Reporting \n\n#### Objective\nDevelop SQL-based analytics to generate key business insights on:\n- **Customer Behavior**\n- **Product Performance**\n- **Sales Trends**\n\n🎯 These insights will provide stakeholders with essential metrics to drive strategic decision-making.\n\n---\n\n\n## 🛡️ License\n\nThis project is licensed under the [MIT License](LICENSE).\n\n## 🌟 About Me\n\nHey there I'm **Charles-emil Fouché** ! Curently working as Sales Man. I’m on a mission to transition from Sales Man to  Data Analyst !\n\nLet's stay in touch! Feel free to connect with me:\n\n[![LinkedIn](https://img.shields.io/badge/LinkedIn-0077B5?style=for-the-badge\u0026logo=linkedin\u0026logoColor=white)](https://www.linkedin.com/in/charles-emil-fouche/)\n\n","funding_links":[],"categories":[],"sub_categories":[],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fcharlesemil%2Fsql-data-warehouse-project","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fcharlesemil%2Fsql-data-warehouse-project","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fcharlesemil%2Fsql-data-warehouse-project/lists"}