{"id":19860992,"url":"https://github.com/muneeb1030/autotrader_web_scapper","last_synced_at":"2026-06-08T02:33:20.028Z","repository":{"id":248393619,"uuid":"801989705","full_name":"Muneeb1030/Autotrader_Web_Scapper","owner":"Muneeb1030","description":"Auto-Trader is website for selling and buying cars. This scraper takes a List of search parameters and scrapper the website against them","archived":false,"fork":false,"pushed_at":"2024-07-16T13:32:51.000Z","size":12,"stargazers_count":1,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-03-01T00:12:52.458Z","etag":null,"topics":["beautifulsoup4","python","selenium-python","webscraping"],"latest_commit_sha":null,"homepage":"https://muhammadmuneeburrehman.vercel.app/","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/Muneeb1030.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2024-05-17T09:53:31.000Z","updated_at":"2024-12-25T10:48:14.000Z","dependencies_parsed_at":"2025-01-11T14:46:01.834Z","dependency_job_id":"b717310a-f1b1-4f74-a570-cd55deba097b","html_url":"https://github.com/Muneeb1030/Autotrader_Web_Scapper","commit_stats":null,"previous_names":["muneeb1030/autotrader"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/Muneeb1030/Autotrader_Web_Scapper","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Muneeb1030%2FAutotrader_Web_Scapper","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Muneeb1030%2FAutotrader_Web_Scapper/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Muneeb1030%2FAutotrader_Web_Scapper/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Muneeb1030%2FAutotrader_Web_Scapper/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/Muneeb1030","download_url":"https://codeload.github.com/Muneeb1030/Autotrader_Web_Scapper/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Muneeb1030%2FAutotrader_Web_Scapper/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":34046003,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-05-26T15:22:16.424Z","status":"online","status_checked_at":"2026-06-08T02:00:07.615Z","response_time":111,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["beautifulsoup4","python","selenium-python","webscraping"],"created_at":"2024-11-12T15:07:44.817Z","updated_at":"2026-06-08T02:33:20.014Z","avatar_url":"https://github.com/Muneeb1030.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Auto Trader Web Scraper\n## Overview\nThe Auto Trader Web Scraper project automates the extraction of vehicle listings from AutoTrader.com. Powered by Python and leveraging BeautifulSoup for parsing, this scraper retrieves detailed information about vehicles based on predefined search queries.\n\n## Key Features\n- **Configuration File Integration**: Utilizes a config.txt file containing search queries to dynamically update URLs and fetch relevant page data.\n- **Data Extraction:** Parses vehicle details such as make, model, year, price, mileage, and location from the HTML content.\n- **CSV Output:** Outputs scraped data into a structured CSV format using Pandas, facilitating easy analysis and further processing.\n- **Automated Scraping:** Automates the scraping process to gather comprehensive data across multiple searches without manual intervention.\n- \n## Requirements\n- Python 3.x\n- BeautifulSoup (bs4)\n- Requests\n- Pandas\n  \n## Getting Started\nClone the Repository:\n\n```bash\nhttps://github.com/Muneeb1030/Autotrader_Web_Scapper.git\ncd auto-trader-scraper\n```\n## Install Dependencies:\n\n```bash\npip install beautifulsoup4 requests pandas\n```\n## Run the Scraper:\n\n```bash\npython auto_trader.py\n```\n\n## Additional Information\n- **Customization:** Modify config.txt to add or change search queries as per your requirements.\n- **GitHub Repository:** Explore and contribute to the project on GitHub.\n  \n## Disclaimer: \nThis scraper should be used responsibly and in accordance with AutoTrader.com's terms of service.\n\n## Author\n- M Muneeb ur Rehman\n\n\nFeel free to contribute and enhance the capabilities of this Auto Trader scraper. Happy scraping! 🚗💻\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fmuneeb1030%2Fautotrader_web_scapper","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fmuneeb1030%2Fautotrader_web_scapper","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fmuneeb1030%2Fautotrader_web_scapper/lists"}