https://github.com/tonimelisma/toyotascrape
Data pipeline to scrape Toyota minivans available online to Parquet files, process and analyze mark-up trends
https://github.com/tonimelisma/toyotascrape
Last synced: 3 months ago
JSON representation
Data pipeline to scrape Toyota minivans available online to Parquet files, process and analyze mark-up trends
- Host: GitHub
- URL: https://github.com/tonimelisma/toyotascrape
- Owner: tonimelisma
- License: mit
- Created: 2023-05-25T16:48:47.000Z (about 2 years ago)
- Default Branch: main
- Last Pushed: 2023-05-29T16:19:28.000Z (about 2 years ago)
- Last Synced: 2025-03-20T14:53:49.764Z (3 months ago)
- Language: Python
- Homepage:
- Size: 1.09 MB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# toyotascrape
Scrape current US Toyota inventory, showing unsold vehicles at different dealerships. Also calculate dealer adjustments, mandatory dealer accessories and other mark-ups for each care (where advertised).
Outputs Parquet and Excel
Pipeline
- Scrape cars
- Transform cars
- Scrape dealers
- Transform cars with dealers
- Calculate dealer markups
- Calculate new cars w/o markups
TODO
- Do calculations to old daily directories idempotently