https://github.com/shishirrsiam/webscraping-with-python
This repository is a beginner-friendly guide to web scraping using Python. It includes simple scripts to help you learn how to extract data from websites.
https://github.com/shishirrsiam/webscraping-with-python
beautifulsoup bs4 python web web-scraping webapp webscraping website
Last synced: about 1 year ago
JSON representation
This repository is a beginner-friendly guide to web scraping using Python. It includes simple scripts to help you learn how to extract data from websites.
- Host: GitHub
- URL: https://github.com/shishirrsiam/webscraping-with-python
- Owner: shishirRsiam
- Created: 2025-05-06T20:04:27.000Z (about 1 year ago)
- Default Branch: main
- Last Pushed: 2025-05-07T21:01:05.000Z (about 1 year ago)
- Last Synced: 2025-05-07T21:35:57.703Z (about 1 year ago)
- Topics: beautifulsoup, bs4, python, web, web-scraping, webapp, webscraping, website
- Language: HTML
- Homepage:
- Size: 10.7 KB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# πΈοΈ WebScraping-With-Python
This repository is a beginner-friendly guide to web scraping using Python. It includes simple scripts to help you learn how to extract data from websites.
---
## π What is Web Scraping?
Web scraping is the process of automatically collecting information from websites. It's useful for things like:
- Getting product prices
- Collecting news articles
- Gathering job listings
---
## π§° Tools Used
- `requests` β to send HTTP requests
- `BeautifulSoup` β to parse HTML content
- `Selenium` β to scrape dynamic websites (optional)
---
## π Example Code
```python
import requests
from bs4 import BeautifulSoup
url = 'https://quotes.toscrape.com/'
res = requests.get(url)
soup = BeautifulSoup(res.text, 'html.parser')
for quote in soup.select('.quote'):
text = quote.select_one('.text').text
author = quote.select_one('.author').text
print(f"{text} β {author}")
````
---
## π¦ Setup
```bash
git clone https://github.com/yourusername/WebScraping-With-Python.git
cd WebScraping-With-Python
pip install -r requirements.txt
```
---
## π Folders (Optional)
* `basics/` β simple scrapers
* `dynamic-sites/` β Selenium examples
* `pagination/` β handling multi-page scraping
---
---
Happy Scraping! π·οΈ