https://github.com/aakk23/wiki-webscrapper-python
This Python project scrapes Wikipedia for the largest U.S. companies by revenue, converting the data into a clean CSV using BeautifulSoup and pandas. It simplifies data collection for analysis and research.
https://github.com/aakk23/wiki-webscrapper-python
beautifulsoup pandas python requests-library-python webscraping
Last synced: 4 months ago
JSON representation
This Python project scrapes Wikipedia for the largest U.S. companies by revenue, converting the data into a clean CSV using BeautifulSoup and pandas. It simplifies data collection for analysis and research.
- Host: GitHub
- URL: https://github.com/aakk23/wiki-webscrapper-python
- Owner: aakk23
- Created: 2025-04-04T21:45:59.000Z (7 months ago)
- Default Branch: main
- Last Pushed: 2025-04-04T21:53:23.000Z (7 months ago)
- Last Synced: 2025-04-09T19:19:16.012Z (7 months ago)
- Topics: beautifulsoup, pandas, python, requests-library-python, webscraping
- Language: Python
- Homepage:
- Size: 6.84 KB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# 📊 Wikipedia Scraper: Largest U.S. Companies by Revenue
This project is a simple Python script that scrapes a Wikipedia page to extract a list of the largest companies in the United States by revenue. The data is then stored in a structured CSV format for further analysis or reference.
---
## 🧰 Tech Stack
- **Python**
- **BeautifulSoup (bs4)** – For HTML parsing and web scraping
- **Pandas** – For data manipulation and exporting to CSV
- **Requests** – For sending HTTP requests
---
## 🔍 What It Does
- Sends a request to the Wikipedia page:
[List of largest companies in the United States by revenue](https://en.wikipedia.org/wiki/List_of_largest_companies_in_the_United_States_by_revenue)
- Parses the first HTML table on the page
- Extracts all rows and cleans the data
- Saves the result as a CSV file locally
---
## 📁 Output
The scraped data is saved to: local storage
You can modify this path as needed for your environment.
---
## 📌 Notes
This script assumes the target table is the first one on the page. If Wikipedia changes the structure, the script may need to be updated.
Always follow Wikipedia's Terms of Use when scraping.
## 📌 Author: Aakkash Aswin
This project is a part of my data analytics portfolio and highlights my Python proficiency relevant to data analyst roles.
### Connect with me on [LinkedIn](http://www.linkedin.com/in/aakkash-aswin)