{"id":22937822,"url":"https://github.com/dimitryzub/ecommerce-scraper-py","last_synced_at":"2025-09-03T23:33:24.772Z","repository":{"id":181687825,"uuid":"625121570","full_name":"dimitryzub/ecommerce-scraper-py","owner":"dimitryzub","description":"Scrape ecommerce websites such as Amazon, eBay, Walmart, Home Depot, Google Shopping from a single module in Python🐍","archived":false,"fork":false,"pushed_at":"2023-07-16T03:57:10.000Z","size":151,"stargazers_count":12,"open_issues_count":0,"forks_count":1,"subscribers_count":1,"default_branch":"main","last_synced_at":"2024-12-27T22:12:12.552Z","etag":null,"topics":["data","datamining","ecommerce","ecommerce-website","python","python3","selectolax","selenium","serpapi","webscraper","webscraping"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/dimitryzub.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null}},"created_at":"2023-04-08T06:08:20.000Z","updated_at":"2024-11-02T16:52:05.000Z","dependencies_parsed_at":"2023-07-16T20:52:19.779Z","dependency_job_id":null,"html_url":"https://github.com/dimitryzub/ecommerce-scraper-py","commit_stats":null,"previous_names":["dimitryzub/ecommerce-scraper-py"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/dimitryzub%2Fecommerce-scraper-py","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/dimitryzub%2Fecommerce-scraper-py/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/dimitryzub%2Fecommerce-scraper-py/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/dimitryzub%2Fecommerce-scraper-py/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/dimitryzub","download_url":"https://codeload.github.com/dimitryzub/ecommerce-scraper-py/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":232154301,"owners_count":18480246,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["data","datamining","ecommerce","ecommerce-website","python","python3","selectolax","selenium","serpapi","webscraper","webscraping"],"created_at":"2024-12-14T12:14:43.395Z","updated_at":"2025-09-03T23:33:24.755Z","avatar_url":"https://github.com/dimitryzub.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"\n\u003ch2 align=\"center\"\u003ePython E-Commerce Scraper 🛒\u003c/h2\u003e\n\n\u003ch4 align=\"center\"\u003e\n  Scrape Amazon, eBay, Walmart, Home Depot and Google Shopping from a single Python module.\n\u003c/h4\u003e\n\n\u003cdiv align=\"center\"\u003e\n   \u003cimg src=\"https://user-images.githubusercontent.com/78694043/231951681-c56b79ce-1643-406c-90c7-39692c6eeaee.svg\" width=\"400\"\u003e\n\u003c/div\u003e\n\n\nThis tool uses [SerpApi](https://serpapi.com/) as a tool to parse data. \n\nYou can use provided API key that will be available after installation, however, it's purely for testing purposes to see if the tool fits your needs. If you'll be using it for your own purpose (personal or commercial), you have to use [your own SerpApi key](https://serpapi.com/manage-api-key).\n\n\n## ⚙️Installation\n\n```bash\n$ pip install ecommerce-scraper-py\n```\n\n## Scrape Google Shopping\n\n#### Example to scrape search page\n\n```python\nfrom google_shopping import GoogleShoppingSearch\n\nscraper = GoogleShoppingSearch(\n    api_key='\u003cyour_serpapi_api_key\u003e',\n    query='coffee',\n    domain='google.de',\n    country='de',\n    language='de',\n    price_from=20,\n    price_to=200,\n    results_limit=150\n)\n\nproducts = scraper.get_products()\nscraper.print(products)\n\nscraper.save_to_json(products)\n```\n\n___\n\n#### Example to scrape product page\n\n```python\nfrom google_shopping import GoogleShoppingProduct\n\nscraper = GoogleShoppingProduct(\n    api_key='\u003cyour_serpapi_api_key\u003e',\n    product_id=14019378181107046593,\n    reviews_limit=125\n)\n\nproduct = scraper.get_product()\nscraper.print(product)\n\nscraper.save_to_json(product)\n```\n\n___\n\n#### Advanced example\n\n```python\nfrom google_shopping import GoogleShoppingSearch, GoogleShoppingProduct\n\nsearch_scraper = GoogleShoppingSearch(\n    api_key='\u003cyour_serpapi_api_key\u003e',\n    query='Sony PlayStation 5',\n    price_from=400,\n    price_to=1000,\n    results_limit=10,\n    domain='google.de',\n    country='de',\n    language='de'\n)\n\ndata = []\n\nproducts = search_scraper.get_products()\n\nfor product in products:\n    product_scraper = GoogleShoppingProduct(\n        api_key='\u003cyour_serpapi_api_key\u003e',\n        product_id=product['product_id'],\n        reviews_limit=15,\n        domain='google.de',\n        country='de',\n        language='de'\n    )\n\n    product_data = product_scraper.get_product()\n    data.append(product_data)\n\nsearch_scraper.print(data)\nsearch_scraper.save_to_json(data)\n```\n\n## Scrape Walmart\n\n#### Example to scrape search page\n\n```python\nfrom walmart import WalmartSearch\n\nscraper = WalmartSearch(\n    api_key='\u003cyour_serpapi_api_key\u003e',\n    query='coffee starbucks',\n    price_from=20,\n    price_to=200,\n    results_limit=150,\n    # store=\"356\"\n)\n\nproducts = scraper.get_products()\nscraper.print(products)\n\nscraper.save_to_json(products)\n```\n\n___\n\n#### Example to scrape product page\n\n```python\nfrom walmart import WalmartProduct\n\nscraper = WalmartProduct(\n    api_key='\u003cyour_serpapi_api_key\u003e',\n    product_id=520468661,\n    reviews_limit=125\n)\n\nproduct = scraper.get_product()\nscraper.print(product)\n\nscraper.save_to_json(product)\n```\n\n___\n\n#### Advanced example\n\n```python\nfrom walmart import WalmartSearch, WalmartProduct\n\nsearch_scraper = WalmartSearch(\n    api_key='\u003cyour_serpapi_api_key\u003e',\n    query='coffee starbucks',\n    price_from=20,\n    price_to=200,\n    results_limit=10\n)\n\ndata = []\n\nproducts = search_scraper.get_products()\n\nfor product in products:\n    product_scraper = WalmartProduct(\n        api_key='\u003cyour_serpapi_api_key\u003e',\n        product_id=product['product_id'],\n        reviews_limit=15\n    )\n\n    product_data = product_scraper.get_product()\n    data.append(product_data)\n\nsearch_scraper.print(data)\nsearch_scraper.save_to_json(data)\n```\n\n## Scrape Home Depot\n\n#### Example to scrape search page\n\n```python\nfrom home_depot import HomeDepotSearch\n\nscraper = HomeDepotSearch(\n    api_key='\u003cyour_serpapi_api_key\u003e',\n    query='chair',\n    price_from=20,\n    price_to=200,\n    results_limit=150,\n    # zip_code='04401'    # zip code must be in the format '12345' or '12345-6789'\n)\n\nproducts = scraper.get_products()\nscraper.print(products)\n\nscraper.save_to_json(products)\n```\n\n___\n\n#### Example to scrape product page\n\n```python\nfrom home_depot import HomeDepotProduct\n\nscraper = HomeDepotProduct(\n    api_key='\u003cyour_serpapi_api_key\u003e',\n    product_id=202054749\n)\n\nproduct = scraper.get_product()\nscraper.print(product)\n\nscraper.save_to_json(product)\n```\n\n___\n\n#### Advanced example\n\n```python\nfrom home_depot import HomeDepotSearch, HomeDepotProduct\n\nsearch_scraper = HomeDepotSearch(\n    api_key='\u003cyour_serpapi_api_key\u003e',\n    query='chair',\n    price_from=20,\n    price_to=200,\n    results_limit=10,\n    zip_code='04401'    # zip code must be in the format '12345' or '12345-6789'\n)\n\ndata = []\n\nproducts = search_scraper.get_products()\n\nfor product in products:\n    product_scraper = HomeDepotProduct(\n        api_key='\u003cyour_serpapi_api_key\u003e',\n        product_id=product['product_id']\n    )\n\n    product_data = product_scraper.get_product()\n    data.append(product_data)\n\nsearch_scraper.print(data)\nsearch_scraper.save_to_json(data)\n```\n\n## Scrape Amazon\n\n#### Example to scrape search page\n\n```python\nfrom amazon import AmazonSearch\n\nscraper = AmazonSearch(\n    query='coffee',\n    results_limit=125,\n    price_from=20,\n    price_to=50,\n    currency='USD',\n    language='en_US',\n    customer_reviews_rating=4,\n    multiplier=1\n)\n\nproducts = scraper.get_products()\nscraper.print(products)\n\nscraper.save_to_json(products)\n```\n\n___\n\n#### Example to scrape product page\n\n```python\nfrom amazon import AmazonProduct\n\nscraper = AmazonProduct(\n    link='https://www.amazon.com/McCafe-Premium-Roast-Decaf-Coffee/dp/B07GCNDL91/ref=sr_1_1?currency=USD\u0026keywords=coffee\u0026qid=1684849762\u0026refinements=p_36%3A2000-5000%2Cp_72%3A1248897011\u0026rnid=1248895011\u0026s=grocery\u0026sr=1-1\u0026th=1',\n    reviews_limit=35,\n    multiplier=1,\n    currency='USD',\n    language='en_US'\n)\n\nproduct = scraper.get_product()\nscraper.print(product)\n\nscraper.save_to_json(product)\n```\n\n___\n\n#### Advanced example\n\n```python\nfrom amazon import AmazonSearch, AmazonProduct\n\nsearch_scraper = AmazonSearch(\n    query='coffee',\n    results_limit=5,\n    price_from=20,\n    price_to=50,\n    currency='USD',\n    language='en_US',\n    customer_reviews_rating=4,\n    multiplier=1\n)\n\ndata = []\n\nproducts = search_scraper.get_products()\n\nfor product in products:\n    product_scraper = AmazonProduct(\n        link=product['link'],\n        reviews_limit=15,\n        multiplier=1,\n        currency='USD',\n        language='en_US'\n    )\n\n    product_data = product_scraper.get_product()\n    data.append(product_data)\n\nsearch_scraper.print(data)\nsearch_scraper.save_to_json(data)\n```\n\n## Scrape eBay\n\n#### Example to scrape search page\n\n```python\nfrom ebay import EbaySearch\n\nscraper = EbaySearch(\n    api_key='\u003cyour_serpapi_api_key\u003e',\n    query='coffee starbucks',\n    price_from=20,\n    price_to=200,\n    results_limit=250,\n    domain='ebay.com'\n)\n\nproducts = scraper.get_products()\nscraper.print(products)\n\nscraper.save_to_json(products)\n```\n\n___\n\n#### Example to scrape product page\n\n```python\nfrom ebay import EbayProduct\n\nscraper = EbayProduct(\n    link='https://www.ebay.com/itm/2-Bags-STARBUCKS-French-Roast-DARK-Whole-Bean-100-Arabica-Coffee-40oz-ea-09-23/144356021636',\n    reviews_limit=125,\n    multiplier=1\n)\n\nproduct = scraper.get_product()\nscraper.print(product)\n\nscraper.save_to_json(product)\n```\n\n___\n\n#### Advanced example\n\n```python\nfrom ebay import EbaySearch, EbayProduct\n\nsearch_scraper = EbaySearch(\n    api_key='\u003cyour_serpapi_api_key\u003e',\n    query='coffee',\n    results_limit=5,\n    domain='ebay.com'\n)\n\ndata = []\n\nproducts = search_scraper.get_products()\n\nfor product in products:\n    product_scraper = EbayProduct(\n        link=product['link'],\n        reviews_limit=15,\n        multiplier=1\n    )\n\n    product_data = product_scraper.get_product()\n    data.append(product_data)\n\nsearch_scraper.print(data)\nsearch_scraper.save_to_json(data)\n```\n\n### ✍Contributing\n\nFeel free to open bug issue, something isn't working, what feature to add, or anything else.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdimitryzub%2Fecommerce-scraper-py","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fdimitryzub%2Fecommerce-scraper-py","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdimitryzub%2Fecommerce-scraper-py/lists"}