{"id":50213703,"url":"https://github.com/octagonai/carvana-scraper","last_synced_at":"2026-05-26T07:03:46.163Z","repository":{"id":253568086,"uuid":"843684213","full_name":"OctagonAI/carvana-scraper","owner":"OctagonAI","description":"Carvana.com Web Scraper generated by Octagon AI to extract vehicle listings available for sale.","archived":false,"fork":false,"pushed_at":"2024-08-28T16:53:22.000Z","size":17,"stargazers_count":1,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"main","last_synced_at":"2024-08-28T18:36:27.885Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/OctagonAI.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2024-08-17T05:23:25.000Z","updated_at":"2024-08-28T16:53:25.000Z","dependencies_parsed_at":"2024-08-22T23:07:08.335Z","dependency_job_id":null,"html_url":"https://github.com/OctagonAI/carvana-scraper","commit_stats":null,"previous_names":["octagonai/carvana-scraper"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/OctagonAI/carvana-scraper","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/OctagonAI%2Fcarvana-scraper","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/OctagonAI%2Fcarvana-scraper/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/OctagonAI%2Fcarvana-scraper/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/OctagonAI%2Fcarvana-scraper/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/OctagonAI","download_url":"https://codeload.github.com/OctagonAI/carvana-scraper/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/OctagonAI%2Fcarvana-scraper/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":33508318,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-05-26T03:12:49.672Z","status":"ssl_error","status_checked_at":"2026-05-26T03:12:47.976Z","response_time":63,"last_error":"SSL_read: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2026-05-26T07:03:38.572Z","updated_at":"2026-05-26T07:03:46.155Z","avatar_url":"https://github.com/OctagonAI.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Carvana Scraper\n### Updated on: Aug 16, 2024\nThis Python script will scrape data from Carvana.com. It extracts data at the detail view by providing a list of URLs of the detail pages of each car listing. This script and the list of URLs are dynamically generated using Octagon AI and contain self healing properties. This means that if any part of the site changes, the script is able to automatically adapt and is dynamically updated to reflect those changes. \n\n![Screenshot 2024-08-16 at 10 45 35 PM](https://github.com/user-attachments/assets/21cc2f69-3e51-4678-825a-d4d6d7e4d291)\n\n## Getting Started\nYou can use this script to extract the following data from Carvana website. You can also modify the script to extract other fields if you desire:\n\n1. “name\": \"2023 Tesla Model 3\"\n2. \"make\": \"Tesla\"\n3. \"model\": \"Model 3 Long Range\"\n4. \"vehicle_price\": “$28,323”\n5. \"mileage\": \"7,353 miles\"\n6. \"location\": \"Haven, KS\"\n\n## Installation\nThis code was written using Python 3.5.\n\nPIP to install the following packages in Python:\n\n\tpip install scrapy scrapy-playwright\n\n## Usage\nYou must run the script using Python with two arguments --list=\"URL-list\" --limit=\"limit\"\n- \"URL-list\": A list of URLs of the detail pages [Required]\n- \"limit\": Maximum number of items to scrape [Optional]\n\nAs an example, I want to build a list of of all Tesla cars for sale:\n\n\tpython scrape_data_carvana.com_20240817.py --list=carvana.com_20240817_detail_pages.txt --limit=1000\n\n## Output\nThis will create both json and csv files:\n\n![Screenshot 2024-08-16 at 10 49 00 PM](https://github.com/user-attachments/assets/02b914cc-981d-4ca0-bfef-ef094211f7f5)\n\n## How should I update the script?\nYou can use Octagon AI to generate a new script in real time. To do so, simply go to https://octagonai.co and sign up.\n\n## Can Octagon AI scrape for me?\nYes, you can use Octagon AI to schedule the scraping to automatically run daily, weekly, or monthly. To do so, simply go to https://octagonai.co and sign up.\n\n\n\n\n\n\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Foctagonai%2Fcarvana-scraper","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Foctagonai%2Fcarvana-scraper","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Foctagonai%2Fcarvana-scraper/lists"}