https://github.com/shimaa83/data_analysis_thanwayaama

EDA analysis for egypt thanwaiaama data set - omdena challenge
https://github.com/shimaa83/data_analysis_thanwayaama

data-science data-visualization eda

Last synced: about 8 hours ago
JSON representation

EDA analysis for egypt thanwaiaama data set - omdena challenge

• Host: GitHub
• URL: https://github.com/shimaa83/data_analysis_thanwayaama
• Owner: shimaa83
• Created: 2022-10-31T14:35:42.000Z (about 2 years ago)
• Default Branch: main
• Last Pushed: 2023-02-02T10:00:08.000Z (almost 2 years ago)
• Last Synced: 2023-03-05T11:27:42.164Z (over 1 year ago)
• Topics: data-science, data-visualization, eda
• Language: Jupyter Notebook
• Homepage:
• Size: 1.3 MB
• Stars: 1
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# data_analysis_thanwayaAma

 Omdena challange

## web scrabbing steps:

- range from 100,000 to 999,999

- Group A(الدور الثانى فقط)only 140,000 student

     - https://g12.emis.gov.eg/

     - https://natega.elwatannews.com/

     - http://natega.elbalad.news/

     - http://natega.dostor.org/ 

- Group B(الدور الاول) 600,000 student

    - https://shbabbek.com/natega

- make http request : https://curlconverter.com/

-  making web scrab using (Beauitful Soub library)

-  three wayes to make web scrabbing::

 1. sync approach:slow way

 2. async approach : faster than sync

 3. async cocurrent way : most effictive way

- last step save the result into csv file

## EDA STEP:

- merge two datset for both first and second trial

- add gender column 

- delete interntional student

- do EDA for the data

## Visualization:

- power BI or tableau  or

- streamlit library in python 

https://app.powerbi.com/groups/me/reports/a635e7f0-7c31-41d7-9031-8871ef6dea1e?ctid=f349c2fd-fc94-4893-abe4-cfbe7ed52842&pbi_source=linkShare