Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/vedanthv/data-engineering-portfolio

Cool DE Projects
https://github.com/vedanthv/data-engineering-portfolio

aws-projects data data-engineering data-modelling databricks portfolio-project python sql

Last synced: about 4 hours ago
JSON representation

Cool DE Projects

Host: GitHub
URL: https://github.com/vedanthv/data-engineering-portfolio
Owner: vedanthv
Created: 2023-09-27T16:15:06.000Z (about 1 year ago)
Default Branch: main
Last Pushed: 2024-11-09T14:52:44.000Z (7 days ago)
Last Synced: 2024-11-09T15:34:51.117Z (7 days ago)
Topics: aws-projects, data, data-engineering, data-modelling, databricks, portfolio-project, python, sql
Language: Jupyter Notebook
Homepage:
Size: 2.03 MB
Stars: 18
Watchers: 1
Forks: 3
Open Issues: 0
Metadata Files:
- Readme: README.md

Awesome Lists containing this project

README

        ![image](https://github.com/vedanthv/data-engineering-portfolio/assets/44313631/664c2886-b8d7-41cd-b231-f9f1ca4bbd3e)

Hello World! I'm Vedanth. 

This is a complete portfolio of the projects I have designed with a major focus on implementing various data engineering tech and cloud services across Azure, AWS and GCP.

Feel Free to Connect with me 🤠

**[LinkedIn](https://www.linkedin.com/in/vedanthbaliga/) | [GitHub](https://github.com/vedanthv/)**

For code snippets integrating various pieces of the DE stack check out my other [repo](https://github.com/vedanthv/data-engineering-code-snippets)

## Quick Links

Here is an index of projects with the tech, domain and link.

### Learning Prototype Projects

I do small projects / prototypes regularly while learning new stuff, not CV worthy but definitely helps to solidify key concepts.

| Project | Domain | 

| :---------: | :---------: |

| [Realtime Ingestion and Transformation with Apache Druid as OLAP Database](https://github.com/vedanthv/data-engineering-portfolio/tree/main/real-time-analytics-druid) | Data Ingestion and Big Data Processing | 

|[Airflow with Postgres as OLTP Database](https://github.com/vedanthv/data-engineering-portfolio/tree/main/airflow-postgres-db)|Data Ingestion and Web Scraping|

### End 2 End Projects

| Project | Tech |

| :---------: | :---------: |

|[InvestIQ Metrics](https://github.com/vedanthv/data-engineering-portfolio/tree/main/investiq-metrics)|AWS EC2,Docker,Airflow,ReapidAPI,AWS Lambda,AWS S3,AWS CloudWatch,AWS Redshift,Prometheus,Grafana,PowerBI|

|[User Mingle : Kafka Driven User Profile Streaming](https://github.com/vedanthv/data-engineering-portfolio/tree/main/user-mingle)|Airflow, Zookeeper, Cassandra, Schema Registry, Spark|  

|[Grand Prix Data Odyssey](https://github.com/vedanthv/data-engineering-projects/tree/main/formula-1-analytics-engg)|Azure Databricks,Spark SQL,Postman,Blob Storage,Unity Catalog,ADF,Azure Devops,Synapse Studio, Delta Lake,PowerBI | 

|[Medal Metrics: Tokyo Olympics Data Alchemy](https://github.com/vedanthv/data-engineering-projects/tree/main/tokyo-olympics-de)|ADF,Azure Data Lake Gen2,Blob Storage,Databricks,Synapse Analytics,PowerBI|