https://github.com/reubenjohn/carresearch

Automates some of the car researching process in the US market
https://github.com/reubenjohn/carresearch

bots cars research-tool web-scraping

Last synced: 3 months ago
JSON representation

Automates some of the car researching process in the US market

• Host: GitHub
• URL: https://github.com/reubenjohn/carresearch
• Owner: reubenjohn
• License: mit
• Created: 2023-06-25T00:15:17.000Z (almost 2 years ago)
• Default Branch: main
• Last Pushed: 2023-07-07T02:19:04.000Z (almost 2 years ago)
• Last Synced: 2025-01-21T08:09:38.147Z (5 months ago)
• Topics: bots, cars, research-tool, web-scraping
• Language: HTML
• Homepage:
• Size: 1.26 MB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# CarResearch

Automates some of the car researching process in the US market through web scraping

## Setup

This is a [poetry](https://python-poetry.org/docs/basic-usage/) project, so make sure you have poetry version 1.2+

installed. Once installed, run the following command to set up the project and install dependencies.

    poetry install

## Usage

To scrape the data from a KBB search results screen:

    poetry run -- scrape-search "https://www.kbb.com/cars-for-sale/all/?isNewSearch=true&marketExtension=include&numRecords=25&searchRadius=0&showAccelerateBanner=false&sortBy=relevance&startYear=2023"

To scrape the data from the listing of a vehicle on KBB:

    poetry run -- scrape-listing "https://www.kbb.com/cars-for-sale/vehicledetails.xhtml?listingId=683600269"