https://github.com/dbeley/pcpartpicker-scraper
Scraper for pcpartpicker.com
https://github.com/dbeley/pcpartpicker-scraper
pcpartpicker
Last synced: 12 days ago
JSON representation
Scraper for pcpartpicker.com
- Host: GitHub
- URL: https://github.com/dbeley/pcpartpicker-scraper
- Owner: dbeley
- License: mit
- Created: 2019-04-05T14:35:40.000Z (about 7 years ago)
- Default Branch: master
- Last Pushed: 2022-12-08T05:51:23.000Z (over 3 years ago)
- Last Synced: 2025-11-22T06:02:22.983Z (7 months ago)
- Topics: pcpartpicker
- Language: Python
- Size: 42 KB
- Stars: 1
- Watchers: 1
- Forks: 0
- Open Issues: 3
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# pcpartpicker-scraper
Scraper for pcpartpicker.com
## Requirements
- bs4
- lxml
- numpy
- pandas
- requests
- selenium
- tqdm
## Installation of the virtualenv (recommended)
```
pipenv install
```
## Usage
```
python get_builds_urls.py
python builds-scraper.py -f FILE_BUILDS_URLS
python get_parts_urls.py
python parts-scraper.py -f FILE_PARTS_URLS
```
## Help
```
python get_builds_urls.py -h
python builds-scraper.py -h
python get_parts_urls.py -h
python parts-scraper.py -h
```