https://github.com/reubenjohn/carresearch
Automates some of the car researching process in the US market
https://github.com/reubenjohn/carresearch
bots cars research-tool web-scraping
Last synced: 3 months ago
JSON representation
Automates some of the car researching process in the US market
- Host: GitHub
- URL: https://github.com/reubenjohn/carresearch
- Owner: reubenjohn
- License: mit
- Created: 2023-06-25T00:15:17.000Z (almost 2 years ago)
- Default Branch: main
- Last Pushed: 2023-07-07T02:19:04.000Z (almost 2 years ago)
- Last Synced: 2025-01-21T08:09:38.147Z (5 months ago)
- Topics: bots, cars, research-tool, web-scraping
- Language: HTML
- Homepage:
- Size: 1.26 MB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# CarResearch
Automates some of the car researching process in the US market through web scraping
## Setup
This is a [poetry](https://python-poetry.org/docs/basic-usage/) project, so make sure you have poetry version 1.2+
installed. Once installed, run the following command to set up the project and install dependencies.poetry install
## Usage
To scrape the data from a KBB search results screen:
poetry run -- scrape-search "https://www.kbb.com/cars-for-sale/all/?isNewSearch=true&marketExtension=include&numRecords=25&searchRadius=0&showAccelerateBanner=false&sortBy=relevance&startYear=2023"
To scrape the data from the listing of a vehicle on KBB:
poetry run -- scrape-listing "https://www.kbb.com/cars-for-sale/vehicledetails.xhtml?listingId=683600269"