https://github.com/bhaskarbharati/web-scraping-project
"Web scraping project using Python, BeautifulSoup, and pandas."
https://github.com/bhaskarbharati/web-scraping-project
data-science jupyter-notebook portfolioproject python3 webscrapping
Last synced: 2 months ago
JSON representation
"Web scraping project using Python, BeautifulSoup, and pandas."
- Host: GitHub
- URL: https://github.com/bhaskarbharati/web-scraping-project
- Owner: bhaskarbharati
- License: mit
- Created: 2025-04-08T21:15:12.000Z (over 1 year ago)
- Default Branch: main
- Last Pushed: 2025-04-08T22:21:44.000Z (over 1 year ago)
- Last Synced: 2025-04-10T03:07:50.229Z (over 1 year ago)
- Topics: data-science, jupyter-notebook, portfolioproject, python3, webscrapping
- Language: Jupyter Notebook
- Homepage:
- Size: 225 KB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# Web Scraping & Data Analysis Project

This project demonstrates how to extract data from a live website using Python and perform basic analysis using `pandas`.
## Overview
In this project, I used **BeautifulSoup** and **requests** to scrape tabular data from a live website (https://en.wikipedia.org/wiki/List_of_largest_companies_in_the_United_States_by_revenue). The extracted HTML content was parsed and cleaned using **pandas**, followed by exporting the clean dataset to a CSV file.
## Technologies Used
- Python 3
- BeautifulSoup
- requests
- pandas
- Jupyter Notebook
## Key Skills Demonstrated
- Web scraping with BeautifulSoup
- HTML parsing and data extraction
- Data cleaning and transformation using pandas
- Exporting structured data to CSV
- Basic exploratory analysis
```
Web-Scraping-project/
├── WebScrapingTutorial.ipynb # Main Jupyter notebook with code and results
├── requirements.txt # Python libraries required to run the project
├── Companies.csv # Exported output data file from the scraping process
├── README.md # Detailed project overview and instructions
├── LICENSE # License info for open-source use
├── .gitignore # Files to ignore in version control
```