Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/dionabazi/web-scraper
https://github.com/dionabazi/web-scraper
information-gathering python script web-scraper website
Last synced: 6 days ago
JSON representation
- Host: GitHub
- URL: https://github.com/dionabazi/web-scraper
- Owner: dionabazi
- Created: 2024-10-16T20:19:33.000Z (about 1 month ago)
- Default Branch: main
- Last Pushed: 2024-10-16T20:23:41.000Z (about 1 month ago)
- Last Synced: 2024-10-18T19:36:22.492Z (about 1 month ago)
- Topics: information-gathering, python, script, web-scraper, website
- Language: Python
- Homepage:
- Size: 5.86 KB
- Stars: 2
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# Web-Scraper
Web Scraper 🌐A simple yet powerful web scraping tool built with Python, designed to extract data from websites seamlessly. This project utilizes requests and BeautifulSoup to scrape and parse HTML content, making it easy for users to gather the information they need from the web.
Features ✨User-friendly: Simple command-line interface for ease of use.
Customizable: Easily modify the target URL and scraping parameters.
Data Extraction: Extracts specific data points from HTML elements.
Export Options: Save scraped data in various formats (e.g., CSV, JSON).Installation 🛠️
Clone the repository:
git clone https://github.com/dionabazi/Web-Scraper.git
cd Web-Scraper
Install required libraries using the requirements.txt file:
bash
pip install -r requirements.txt --break-system-packages
Usage 🚀
Open the command line and navigate to the project directory.
Run the scraper with the desired URL:
python web_scraper.py
Follow the prompts to specify the data you wish to extract.
Contributing 🤝
Contributions are welcome! If you have suggestions for improvements or new features, please fork the repository and submit a pull request.
License 📄This project is licensed under the MIT License. See the LICENSE file for details.
Screenshots
![Screenshot_2024-10-16_16_20_51](https://github.com/user-attachments/assets/9f3f1462-23ce-4034-bba5-070cff8f6de3)
![Screenshot_2024-10-16_16_22_01](https://github.com/user-attachments/assets/43870a84-ffb4-4ad4-a1e8-f251fdde1dc2)
[![bmc-button (2)](https://github.com/user-attachments/assets/8a994d82-5bf8-480e-9e64-728d5aba2e14)](https://ko-fi.com/dionabazi)
Thank you for your support! 💕