{"id":20970166,"url":"https://github.com/shimaa83/data_analysis_thanwayaama","last_synced_at":"2025-07-22T14:04:39.011Z","repository":{"id":64216890,"uuid":"559999582","full_name":"shimaa83/data_analysis_thanwayaAma","owner":"shimaa83","description":"EDA analysis for egypt thanwaiaama data set - omdena challenge ","archived":false,"fork":false,"pushed_at":"2023-02-02T10:00:08.000Z","size":1361,"stargazers_count":1,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-03-13T08:17:44.051Z","etag":null,"topics":["data-science","data-visualization","eda"],"latest_commit_sha":null,"homepage":"","language":"Jupyter Notebook","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/shimaa83.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2022-10-31T14:35:42.000Z","updated_at":"2023-03-02T20:28:44.000Z","dependencies_parsed_at":"2023-02-17T18:15:57.110Z","dependency_job_id":null,"html_url":"https://github.com/shimaa83/data_analysis_thanwayaAma","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/shimaa83/data_analysis_thanwayaAma","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/shimaa83%2Fdata_analysis_thanwayaAma","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/shimaa83%2Fdata_analysis_thanwayaAma/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/shimaa83%2Fdata_analysis_thanwayaAma/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/shimaa83%2Fdata_analysis_thanwayaAma/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/shimaa83","download_url":"https://codeload.github.com/shimaa83/data_analysis_thanwayaAma/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/shimaa83%2Fdata_analysis_thanwayaAma/sbom","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":266507366,"owners_count":23940055,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","status":"online","status_checked_at":"2025-07-22T02:00:09.085Z","response_time":66,"last_error":null,"robots_txt_status":null,"robots_txt_updated_at":null,"robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["data-science","data-visualization","eda"],"created_at":"2024-11-19T03:57:02.750Z","updated_at":"2025-07-22T14:04:38.981Z","avatar_url":"https://github.com/shimaa83.png","language":"Jupyter Notebook","funding_links":[],"categories":[],"sub_categories":[],"readme":"# data_analysis_thanwayaAma\n Omdena challange\n## web scrabbing steps:\n- range from 100,000 to 999,999\n- Group A(الدور الثانى فقط)only 140,000 student\n     - https://g12.emis.gov.eg/\n     - https://natega.elwatannews.com/\n     - http://natega.elbalad.news/\n     - http://natega.dostor.org/ \n\n- Group B(الدور الاول) 600,000 student\n    - https://shbabbek.com/natega\n\n- make http request : https://curlconverter.com/\n-  making web scrab using (Beauitful Soub library)\n-  three wayes to make web scrabbing::\n 1. sync approach:slow way\n 2. async approach : faster than sync\n 3. async cocurrent way : most effictive way\n- last step save the result into csv file\n## EDA STEP:\n- merge two datset for both first and second trial\n- add gender column \n- delete interntional student\n- do EDA for the data\n## Visualization:\n- power BI or tableau  or\n- streamlit library in python \nhttps://app.powerbi.com/groups/me/reports/a635e7f0-7c31-41d7-9031-8871ef6dea1e?ctid=f349c2fd-fc94-4893-abe4-cfbe7ed52842\u0026pbi_source=linkShare\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fshimaa83%2Fdata_analysis_thanwayaama","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fshimaa83%2Fdata_analysis_thanwayaama","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fshimaa83%2Fdata_analysis_thanwayaama/lists"}