Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/dbeley/pcpartpicker-scraper
Scraper for pcpartpicker.com
https://github.com/dbeley/pcpartpicker-scraper
pcpartpicker
Last synced: about 1 month ago
JSON representation
Scraper for pcpartpicker.com
- Host: GitHub
- URL: https://github.com/dbeley/pcpartpicker-scraper
- Owner: dbeley
- License: mit
- Created: 2019-04-05T14:35:40.000Z (over 5 years ago)
- Default Branch: master
- Last Pushed: 2022-12-08T05:51:23.000Z (about 2 years ago)
- Last Synced: 2023-03-02T21:01:53.823Z (almost 2 years ago)
- Topics: pcpartpicker
- Language: Python
- Size: 42 KB
- Stars: 0
- Watchers: 2
- Forks: 0
- Open Issues: 3
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# pcpartpicker-scraper
Scraper for pcpartpicker.com
## Requirements
- bs4
- lxml
- numpy
- pandas
- requests
- selenium
- tqdm
## Installation of the virtualenv (recommended)
```
pipenv install
```
## Usage
```
python get_builds_urls.py
python builds-scraper.py -f FILE_BUILDS_URLS
python get_parts_urls.py
python parts-scraper.py -f FILE_PARTS_URLS
```
## Help
```
python get_builds_urls.py -h
python builds-scraper.py -h
python get_parts_urls.py -h
python parts-scraper.py -h
```