An open API service indexing awesome lists of open source software.

https://github.com/kmohamedalie/python-project-for-data-engineering

Python Project for Data Engineering
https://github.com/kmohamedalie/python-project-for-data-engineering

data-engineering extract-transform-load python webscrapping

Last synced: 8 months ago
JSON representation

Python Project for Data Engineering

Awesome Lists containing this project

README

          

# Python Project for Data Engineering

**The following project is part of [IBM Data Engineering program](https://www.coursera.org/professional-certificates/ibm-data-engineer?myLearningTab=IN_PROGRESS)**

![image](https://github.com/user-attachments/assets/577dc3e6-6f4f-44d3-9c9f-3d0d0f0a7ab6)
[1. ETL-project](https://github.com/Kmohamedalie/Python-Project-for-Data-Engineering/tree/master/1.%20ETL-project)

[2. web scraping API - project](https://github.com/Kmohamedalie/Python-Project-for-Data-Engineering/tree/master/2.%20web%20scraping%20API%20-%20project)

[3. Accessing and Loading DB](https://github.com/Kmohamedalie/Python-Project-for-Data-Engineering/tree/master/3.%20Accessing%20and%20Loading%20DB)


### **Practice Project Scenario:**

An international firm that is looking to expand its business in different countries across the world has recruited you. You have been hired as a junior Data Engineer and are tasked with creating an automated script that can extract the list of all countries in order of their [GDPs in billion USDs](https://en.wikipedia.org/wiki/List_of_countries_by_GDP_(nominal)) (rounded to 2 decimal places), as logged by the International Monetary Fund (IMF). Since IMF releases this evaluation twice a year, this code will be used by the organization to extract the information as it is updated.

https://github.com/user-attachments/assets/54e21fe1-e1b6-47c2-b2a7-87e2a0b76298