https://github.com/bitoollearner/bilearner-ds-lab

This Repository is dedicated for data engineering projects
https://github.com/bitoollearner/bilearner-ds-lab

data-engineering data-engineering-pipeline fabric microsoft-fabric spark sql

Last synced: 1 day ago
JSON representation

This Repository is dedicated for data engineering projects

• Host: GitHub
• URL: https://github.com/bitoollearner/bilearner-ds-lab
• Owner: bitoollearner
• License: mit
• Created: 2025-06-22T09:28:21.000Z (10 months ago)
• Default Branch: main
• Last Pushed: 2026-03-15T09:31:03.000Z (about 2 months ago)
• Last Synced: 2026-03-15T22:39:57.900Z (about 1 month ago)
• Topics: data-engineering, data-engineering-pipeline, fabric, microsoft-fabric, spark, sql
• Homepage:
• Size: 14.9 MB
• Stars: 1
• Watchers: 0
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

          
# Data Engineering Projects Repository

Welcome to my GitHub repository for data engineering projects! This repository contains end-to-end projects I’ve built and explained on my YouTube channel. Each project demonstrates real-world data engineering use cases using modern tools and platforms.

| S.No | Project Name               | Description                                                                                             | Industry Type      | Technologies Used                                                       | Level    | Repo Link                                                                                      |

|------|----------------------------|---------------------------------------------------------------------------------------------------------|--------------------|---------------------------------------------------------------------------|----------|------------------------------------------------------------------------------------------------|

| 1    | Yahoo Finance Stock Lakehouse | Microsoft Fabric–based pipeline using Medallion architecture for ingesting, transforming, and serving Yahoo Finance data with MLFlow, CI/CD, and Power BI integration. | Finance/Stock Market | Microsoft Fabric, PySpark, Lakehouse, SQL, Power BI, CI/CD         | Advanced | [...](https://github.com/bitoollearner/de-project-BI-Learner/tree/main/yahoo-finance) |

---

## 🎯 What You’ll Learn From These Projects

- Designing real enterprise-style data architectures  

- Building scalable pipelines  

- Implementing modern Lakehouse patterns  

- Applying DevOps principles to data workflows  

- Creating analytics-ready data models  

---

## 📺 YouTube Channel

Check out my channel [BI Learner](https://www.youtube.com/@bilearner) for detailed video tutorials and demonstrations of these projects.

---

## 🙋‍♂️ About Me

I'm a Data Engineer, Bi Consultant, and content creator focused on delivering real-world projects in the data ecosystem. This repository is designed to help others understand, implement, and gain confidence in building production-grade data solutions.

---

## ⭐ Support the Work

If you find these projects helpful, consider **starring the repository** to support the work and help others discover it.