https://github.com/mekwiset/mekwiset

https://github.com/mekwiset/mekwiset

Last synced: 3 months ago
JSON representation

• Host: GitHub
• URL: https://github.com/mekwiset/mekwiset
• Owner: MekWiset
• Created: 2024-07-21T16:28:09.000Z (11 months ago)
• Default Branch: main
• Last Pushed: 2024-10-16T10:18:30.000Z (8 months ago)
• Last Synced: 2024-10-18T00:58:28.453Z (8 months ago)
• Size: 2.2 MB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
Hi there 👋, I'm Mek




    





As a passionate Junior Data Engineer, I specialize in leveraging data to drive impactful insights and solutions. I thrive on solving complex data challenges and enjoy working with diverse technologies to optimize data pipelines and workflows. With a strong foundation in data engineering tools and methodologies, I am particularly interested in exploring advancements in data science, cloud computing, and big data analytics. 

My goal is to contribute to innovative projects that harness the power of data to create meaningful outcomes and drive progress in various industries.



- 📫 How to reach me: [email protected]

- 📄 Know about my experiences: [https://www.linkedin.com/in/siriwat-wisetpakdeewong-78b641256/](https://www.linkedin.com/in/siriwat-wisetpakdeewong-78b641256/)

- ⭐️ View my resume: [Click Here](https://drive.google.com/file/d/1UP6nrpnJiu_JMxbAWhsqxt13RWENKJbf/view?usp=sharing)

🔗 Connect with me:



[![LinkedIn](https://img.shields.io/badge/linkedin-%230077B5.svg?style=for-the-badge&logo=linkedin&logoColor=white)](https://www.linkedin.com/in/siriwat-wisetpakdeewong-78b641256/)

[![Gmail](https://img.shields.io/badge/Gmail-D14836?style=for-the-badge&logo=gmail&logoColor=white)](mailto:[email protected])

[![Medium](https://img.shields.io/badge/Medium-12100E?style=for-the-badge&logo=medium&logoColor=white)](https://medium.com/@siriwatwisetpakdeewong)

💻 Languages and Tools:



![Python](https://img.shields.io/badge/python-3670A0?style=for-the-badge&logo=python&logoColor=ffdd54)

![Apache Airflow](https://img.shields.io/badge/Apache%20Airflow-017CEE?style=for-the-badge&logo=Apache%20Airflow&logoColor=white)

![Apache Kafka](https://img.shields.io/badge/Apache%20Kafka-000?style=for-the-badge&logo=apachekafka)

![Pandas](https://img.shields.io/badge/pandas-%23150458.svg?style=for-the-badge&logo=pandas&logoColor=white)

![Apache Spark](https://img.shields.io/badge/Apache%20Spark-FDEE21?style=flat-square&logo=apachespark&logoColor=black)

![Docker](https://img.shields.io/badge/docker-%230db7ed.svg?style=for-the-badge&logo=docker&logoColor=white)

![AWS](https://img.shields.io/badge/AWS-%23FF9900.svg?style=for-the-badge&logo=amazon-aws&logoColor=white)

![Azure](https://img.shields.io/badge/azure-%230072C6.svg?style=for-the-badge&logo=microsoftazure&logoColor=white)

![Google Cloud](https://img.shields.io/badge/GoogleCloud-%234285F4.svg?style=for-the-badge&logo=google-cloud&logoColor=white)

![Postgres](https://img.shields.io/badge/postgres-%23316192.svg?style=for-the-badge&logo=postgresql&logoColor=white)

![ApacheCassandra](https://img.shields.io/badge/cassandra-%231287B1.svg?style=for-the-badge&logo=apache-cassandra&logoColor=white)

![MongoDB](https://img.shields.io/badge/MongoDB-%234ea94b.svg?style=for-the-badge&logo=mongodb&logoColor=white)

![macOS](https://img.shields.io/badge/mac%20os-000000?style=for-the-badge&logo=macos&logoColor=F0F0F0)

![Visual Studio Code](https://img.shields.io/badge/Visual%20Studio%20Code-0078d7.svg?style=for-the-badge&logo=visual-studio-code&logoColor=white)

![Notion](https://img.shields.io/badge/Notion-%23000000.svg?style=for-the-badge&logo=notion&logoColor=white)

### 📝 Recent Medium Articles






---

## 🚀 Featured Projects

### 1. [LiquorSales Data Migration Pipeline](https://github.com/MekWiset/LiquorSales_Data_Migration_Pipeline)

- **ℹ️ Description:** Big Data Migration from GCP to Azure.

- **🏆 Achievements:** Successfully migrated over 19 million rows of data from Google Cloud Storage to Azure Data Lake, ensuring data integrity with zero data loss.

- **🎯 Technologies used:**

    - **Processing Tools:** PySpark

    - **GCP Services:** Google Cloud Storage (GCS), BigQuery

    - **Azure Services:** Azure Data Factory, Azure Data Lake Storage Gen 2, Databricks, Key Vault

    - **Others:** Docker

### 2. [Medallion Data Lakehouse](https://github.com/MekWiset/Medallion_DataLakehouse_project)

- **ℹ️ Description:** Building a Data Lakehouse using the Medallion architecture.

- **🏆 Achievements:** Developed a scalable Data Lakehouse architecture using the Medallion framework, facilitating efficient data storage, processing, and analysis with seamless integration across Azure services.

- **🎯 Technologies used:**

    - **Processing Tools:** DBT (Data Build Tool)

    - **Azure Services:** Azure SQL Database, Azure Data Lake Storage Gen 2, Databricks, Azure Key Vault

### 3. [Realtime Data Streaming](https://github.com/MekWiset/Realtime_Data_Streaming_project)

- **ℹ️ Description:** Real-time data ingestion to Cassandra using Airflow, Kafka, and Spark.

- **🏆 Achievements:** Engineered a robust real-time data streaming pipeline, enabling low-latency data ingestion into Cassandra and ensuring consistent data flow and processing across multiple platforms.

- **🎯 Technologies used:**

    - **Processing Tools:** PySpark

    - **Orchestration Tools:** Airflow, Kafka, Zookeeper

    - **Monitoring:** Confluent

    - **Storage:** Cassandra

    - **Others:** Docker

 

---