https://github.com/robbiebusinessacc/template_web_scraper
template_web_scraper is a Python web scraping tool that allows you to collect and analyze data from websites. The tool has been designed to be easy to use and allows you to extract data from websites with minimal coding required.
https://github.com/robbiebusinessacc/template_web_scraper
csv html template template-repository webscraper
Last synced: 2 months ago
JSON representation
template_web_scraper is a Python web scraping tool that allows you to collect and analyze data from websites. The tool has been designed to be easy to use and allows you to extract data from websites with minimal coding required.
- Host: GitHub
- URL: https://github.com/robbiebusinessacc/template_web_scraper
- Owner: robbiebusinessacc
- License: mit
- Created: 2023-01-19T03:48:06.000Z (about 3 years ago)
- Default Branch: main
- Last Pushed: 2024-04-23T20:59:02.000Z (almost 2 years ago)
- Last Synced: 2024-04-23T22:52:52.855Z (almost 2 years ago)
- Topics: csv, html, template, template-repository, webscraper
- Language: Python
- Homepage:
- Size: 50.8 KB
- Stars: 1
- Watchers: 2
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# template_web_scraper
template_web_scraper is a Python web scraping tool template that allows you to collect and analyze data from websites. The tool has been designed to be easy to use and allows you to extract data from websites with minimal coding required.
## Features
- Scrapes data from any website
- Extracts data in a structured format
- Saves data to a CSV file
## Installation
1. Download the project as a zip file from GitHub
2. Extract the files to your local machine
3. Run the following command inside the main folder to install the required dependencies:
MacOS:`python3 -m pip install -r requirements.txt`
Other:`pip install -r requirements.txt`
## Usage
1. `cd examples`
2. `python3 example_usage.py`
The script will scrape the data from worldometers website, parse the HTML and save the data to a CSV file.
## Tests
To run the tests, use the following command:
`python3 -m unittest discover -s tests/ -p "*_test.py"`
## Contribution
We welcome contributions to the project. If you have an idea for a new feature or have found a bug, please open an issue. If you would like to contribute to the code, please fork the repository and open a pull request.
## License
This project is licensed under the MIT License - see the [LICENSE](LICENSE) file for details.