{"id":20892496,"url":"https://github.com/prajjwol09/web-scraping","last_synced_at":"2026-04-21T18:03:15.815Z","repository":{"id":256370353,"uuid":"855071123","full_name":"Prajjwol09/Web-Scraping","owner":"Prajjwol09","description":"This project is a Python-based web scraper that extracts data on the largest public companies in the US by revenue from Wikipedia.","archived":false,"fork":false,"pushed_at":"2024-09-10T08:57:55.000Z","size":6,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-12-12T21:35:56.192Z","etag":null,"topics":["beautifulsoup4","csv","dataframe","pandas","requests","webscraping"],"latest_commit_sha":null,"homepage":"","language":"Jupyter Notebook","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/Prajjwol09.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2024-09-10T08:55:54.000Z","updated_at":"2024-09-10T08:59:52.000Z","dependencies_parsed_at":null,"dependency_job_id":"649ece7a-af97-4026-ab6b-824b312eac21","html_url":"https://github.com/Prajjwol09/Web-Scraping","commit_stats":null,"previous_names":["prajjwol09/web-scraping"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/Prajjwol09/Web-Scraping","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Prajjwol09%2FWeb-Scraping","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Prajjwol09%2FWeb-Scraping/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Prajjwol09%2FWeb-Scraping/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Prajjwol09%2FWeb-Scraping/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/Prajjwol09","download_url":"https://codeload.github.com/Prajjwol09/Web-Scraping/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Prajjwol09%2FWeb-Scraping/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":32103647,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-04-21T11:25:29.218Z","status":"ssl_error","status_checked_at":"2026-04-21T11:25:28.499Z","response_time":128,"last_error":"SSL_connect returned=1 errno=0 peeraddr=140.82.121.5:443 state=error: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["beautifulsoup4","csv","dataframe","pandas","requests","webscraping"],"created_at":"2024-11-18T10:13:06.754Z","updated_at":"2026-04-21T18:03:15.773Z","avatar_url":"https://github.com/Prajjwol09.png","language":"Jupyter Notebook","funding_links":[],"categories":[],"sub_categories":[],"readme":"Largest Public Companies in the US Web Scraping Project\n\nOverview:\n\nThis project is a Python-based web scraper that extracts the list of the largest public companies in the United States by revenue from Wikipedia. Using the BeautifulSoup library for parsing and requests for fetching the webpage, it scrapes relevant data, structures it in a DataFrame using pandas, and exports the result to a CSV file for further analysis.\n\nFeatures:\n\nScrapes data from a Wikipedia page containing a table of the largest public companies in the US.\n\nExtracts company information such as ranking, name, revenue, and other details from the table.\n\nStores the scraped data in a pandas DataFrame.\n\nExports the data to a CSV file.\n\nTechnologies Used:\n\nPython: The core programming language used to write the script.\n\nRequests: To fetch the HTML content of the Wikipedia page.\n\nBeautifulSoup: For parsing and navigating the HTML content to extract data.\n\nPandas: For data manipulation and exporting the scraped data to a CSV file.\n\nJupyter Notebook (Optional): For testing and experimenting with the code interactively.\n\nPrerequisites:\n\nEnsure you have the following libraries installed:\n\nrequests: For making HTTP requests to fetch the webpage.\n\nBeautifulSoup: For parsing the HTML page.\n\npandas: For data manipulation and CSV export.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fprajjwol09%2Fweb-scraping","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fprajjwol09%2Fweb-scraping","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fprajjwol09%2Fweb-scraping/lists"}