{"id":23150168,"url":"https://github.com/shahrozatiq/ebay-scraper","last_synced_at":"2025-04-04T14:42:34.240Z","repository":{"id":264700736,"uuid":"894136678","full_name":"ShahrozAtiq/Ebay-Scraper","owner":"ShahrozAtiq","description":"This bot automates the process of extracting comprehensive data from eBay based on a given keyword. It navigates through eBay's search results, collects product and seller information, retrieves all products listed by the sellers, and fetches the sales history for each product. The data is meticulously organized and saved into multiple CSV files","archived":false,"fork":false,"pushed_at":"2024-11-25T21:29:28.000Z","size":2689,"stargazers_count":1,"open_issues_count":1,"forks_count":0,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-02-10T00:28:34.992Z","etag":null,"topics":["automation","automation-bot","bot","ebay","ebay-products-data-scraper","ebay-scraper","python","selenium","selenium-python","selenium-webdriver","undetectable-browser"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/ShahrozAtiq.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2024-11-25T20:23:48.000Z","updated_at":"2025-01-03T14:39:05.000Z","dependencies_parsed_at":"2024-11-25T21:38:28.659Z","dependency_job_id":null,"html_url":"https://github.com/ShahrozAtiq/Ebay-Scraper","commit_stats":null,"previous_names":["shahrozatiq/ebay-scraper"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ShahrozAtiq%2FEbay-Scraper","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ShahrozAtiq%2FEbay-Scraper/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ShahrozAtiq%2FEbay-Scraper/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ShahrozAtiq%2FEbay-Scraper/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/ShahrozAtiq","download_url":"https://codeload.github.com/ShahrozAtiq/Ebay-Scraper/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":247198412,"owners_count":20900078,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["automation","automation-bot","bot","ebay","ebay-products-data-scraper","ebay-scraper","python","selenium","selenium-python","selenium-webdriver","undetectable-browser"],"created_at":"2024-12-17T18:16:35.577Z","updated_at":"2025-04-04T14:42:34.214Z","avatar_url":"https://github.com/ShahrozAtiq.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"\u003ch1 align=\"center\"\u003e\n\tEbay Products Data Scraper\n\u003c/h1\u003e\n\n\u003e [!IMPORTANT]\n\u003e Contact me if you need a bot like this\n\n\n## Demo\n\nhttps://github.com/user-attachments/assets/5ba9135d-597c-47c5-87e0-189d1b67aeff\n\n\n\n\u003ch1 align=\"center\"\u003e\n\tScreenShots\n\u003c/h1\u003e\n\u003cp align=\"center\"\u003e\n\t\u003cimg src=\"https://github.com/ShahrozAtiq/Ebay-Scraper/blob/b62dea6aaa564f1bd150a2f1f62f6295b482a9cc/Ebay_data.png\"\u003e\n\t\u003cimg src=\"https://github.com/ShahrozAtiq/Ebay-Scraper/blob/b62dea6aaa564f1bd150a2f1f62f6295b482a9cc/Ebay_.png\"\u003e\n\u003c/p\u003e\n\n## Discription\n\nThis bot automates the process of extracting comprehensive data from eBay based on a given keyword. It navigates through eBay's search results, collects product and seller information, retrieves all products listed by the sellers, and fetches the sales history for each product. The data is meticulously organized and saved into multiple CSV files for easy analysis\n\n## Features\n\n### 1. **Keyword Search**\n- Accepts a txt file with keyword seperated by new line to search for products on eBay.\n- Scrapes search results, including essential product details such as id, product link, title, price, seller name, shipping cost, sold items, available items, and Views/in basket\n\n## 2. **Seller Information Collection**\n\n- Extracts detailed seller data for each product\n- Including: Seller name, Number of followers, \"Member since\" date\n\n### 3. **Seller Profile Scraping**\n\n- Visits each seller's profile to retrieve all listed products.\n- Collects detailed product data\n- Including: Product titles, Prices, Product IDs, Available stock\n\n### 4. **Sales History Extraction**\n\n- For every scraped product, fetches historical sales data \n- Such as: Number of units sold, Sale dates, Selling price for each transaction\n\n### 5. **Data Storage**\n\n- Saves data in a structured format across multiple CSV files:\n- data_by_keywords.csv: Contains keyword search product details.\n- data_by_sellers.csv: Includes information about all sellers.\n- products_history.csv: Documents the sales history for every product.\n\n6. **Efficiency \u0026 Scalability**\n\n- Handles large datasets efficiently.\n- Optimized to avoid triggering eBay's anti-bot measures with delays and headers.\n\n##Use Cases:\n\n- Market analysis for products and sellers on eBay.\n- Competitive analysis and pricing research.\n- Business decision-making based on historical sales data.\n\n## Technologies Used\n\n- ![Undetected_Chromedriver](https://img.shields.io/badge/-Undetected_Chromedriver-green)\n- ![Selenium](https://img.shields.io/badge/-Selenium-blue)\n- ![CSV](https://img.shields.io/badge/-CSV-yellow)\n\n### Running the project\n\nClone this repository :\n\n```\ngit clone https://github.com/ShahrozAtiq/Ebay-Scraper.git\ncd Ebay-Scraper\n```\n\n## Contact Me\n\nContact me if you need a bot like this\n\n\u003ctable\u003e\n  \u003ctr\u003e\n    \u003ctd align=\"center\" width=\"500px\"\u003e\n      \u003ca href=\"https://www.upwork.com/freelancers/~01c437b099d917194b\" title=\"View my Upwork profile\"\u003e\n        \u003cimg src=\"https://img.icons8.com/external-tal-revivo-shadow-tal-revivo/48/null/external-upwork-a-global-freelancing-platform-where-professionals-connect-and-collaborate-remotely-logo-shadow-tal-revivo.png\" alt=\"Upwork Icon\" width=\"60\" height=\"60\"/\u003e\n      \u003c/a\u003e\n    \u003c/td\u003e\n    \u003ctd align=\"center\" width=\"500px\"\u003e\n      \u003ca href=\"https://www.fiverr.com/shahrozatiq\" title=\"View my Fiverr profile\"\u003e\n        \u003cimg src=\"https://ml.globenewswire.com/Resource/Download/dcc91863-eeb0-4879-a556-9f7608b19744\" alt=\"Fiverr Icon\" width=\"60\" height=\"60\"/\u003e\n      \u003c/a\u003e\n    \u003c/td\u003e\n    \u003ctd align=\"center\" width=\"500px\"\u003e\n      \u003ca href=\"mailto:shahrozatiq123@gmail.com\" title=\"Send me an email\"\u003e\n        \u003cimg src=\"https://www.svgrepo.com/show/452213/gmail.svg\" alt=\"Gmail Icon\" height=\"60\" width=\"60\"/\u003e\n      \u003c/a\u003e\n    \u003c/td\u003e\n    \u003ctd align=\"center\" width=\"500px\"\u003e\n      \u003ca href=\"https://wa.me/923014317809\" title=\"Chat with me on WhatsApp\"\u003e\n        \u003cimg src=\"https://raw.githubusercontent.com/rahuldkjain/github-profile-readme-generator/master/src/images/icons/Social/whatsapp.svg\" alt=\"WhatsApp Icon\" height=\"60\" width=\"60\"/\u003e\n      \u003c/a\u003e\n    \u003c/td\u003e\n    \u003ctd align=\"center\" width=\"500px\"\u003e\n      \u003ca href=\"https://linkedin.com/in/shahroz-atiq\" title=\"Connect with me on LinkedIn\"\u003e\n        \u003cimg src=\"https://raw.githubusercontent.com/rahuldkjain/github-profile-readme-generator/master/src/images/icons/Social/linked-in-alt.svg\" alt=\"LinkedIn Icon\" height=\"60\" width=\"60\"/\u003e\n      \u003c/a\u003e\n    \u003c/td\u003e\n    \u003ctd align=\"center\" width=\"500px\"\u003e\n      \u003ca href=\"https://instagram.com/shahahahahroz\" title=\"Follow me on Instagram\"\u003e\n        \u003cimg src=\"https://raw.githubusercontent.com/rahuldkjain/github-profile-readme-generator/master/src/images/icons/Social/instagram.svg\" alt=\"Instagram Icon\" height=\"60\" width=\"60\"/\u003e\n      \u003c/a\u003e\n    \u003c/td\u003e\n  \u003c/tr\u003e\n  \u003ctr\u003e\n    \u003ctd align=\"center\" width=\"500px\"\u003e\n      \u003ca href=\"https://www.upwork.com/freelancers/~01c437b099d917194b\"\u003eUpwork\u003c/a\u003e\n    \u003c/td\u003e\n    \u003ctd align=\"center\" width=\"500px\"\u003e\n      \u003ca href=\"https://www.fiverr.com/shahrozatiq\"\u003eFiverr\u003c/a\u003e\n    \u003c/td\u003e\n    \u003ctd align=\"center\" width=\"500px\"\u003e\n      \u003ca href=\"mailto:shahrozatiq123@gmail.com\"\u003eGmail\u003cbr\u003eshahrozatiq123@gmail.com\u003c/a\u003e\n    \u003c/td\u003e\n    \u003ctd align=\"center\" width=\"500px\"\u003e\n      \u003ca href=\"https://wa.me/923014317809\"\u003eWhatsApp\u003cbr\u003e+923014317809\u003c/a\u003e\n    \u003c/td\u003e\n    \u003ctd align=\"center\" width=\"500px\"\u003e\n      \u003ca href=\"https://linkedin.com/in/shahroz-atiq\"\u003eLinkedIn\u003c/a\u003e\n    \u003c/td\u003e\n    \u003ctd align=\"center\" width=\"500px\"\u003e\n      \u003ca href=\"https://instagram.com/shahahahahroz\"\u003eInstagram\u003c/a\u003e\n    \u003c/td\u003e\n  \u003c/tr\u003e\n\u003c/table\u003e\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fshahrozatiq%2Febay-scraper","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fshahrozatiq%2Febay-scraper","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fshahrozatiq%2Febay-scraper/lists"}