{"id":29127117,"url":"https://github.com/danieladdisonorg/ecommerce-scraping-api","last_synced_at":"2025-06-30T00:09:03.723Z","repository":{"id":300194680,"uuid":"1005498206","full_name":"danieladdisonorg/Ecommerce-Scraping-API","owner":"danieladdisonorg","description":null,"archived":false,"fork":false,"pushed_at":"2025-06-20T10:19:07.000Z","size":0,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":0,"default_branch":"main","last_synced_at":"2025-06-20T10:51:00.449Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"PHP","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/danieladdisonorg.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null}},"created_at":"2025-06-20T10:16:43.000Z","updated_at":"2025-06-20T10:19:15.000Z","dependencies_parsed_at":"2025-06-20T10:51:04.952Z","dependency_job_id":"2bf7a4aa-6287-461b-8743-c1de32a92c91","html_url":"https://github.com/danieladdisonorg/Ecommerce-Scraping-API","commit_stats":null,"previous_names":["danieladdisonorg/ecommerce-scraping-api"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/danieladdisonorg/Ecommerce-Scraping-API","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/danieladdisonorg%2FEcommerce-Scraping-API","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/danieladdisonorg%2FEcommerce-Scraping-API/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/danieladdisonorg%2FEcommerce-Scraping-API/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/danieladdisonorg%2FEcommerce-Scraping-API/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/danieladdisonorg","download_url":"https://codeload.github.com/danieladdisonorg/Ecommerce-Scraping-API/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/danieladdisonorg%2FEcommerce-Scraping-API/sbom","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":262685699,"owners_count":23348452,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2025-06-30T00:09:02.888Z","updated_at":"2025-06-30T00:09:03.717Z","avatar_url":"https://github.com/danieladdisonorg.png","language":"PHP","funding_links":[],"categories":[],"sub_categories":[],"readme":"# eCommerce Scraping API\n\n\u003cp align=\"center\"\u003e\n    \u003ca href=\"https://dashboard.smartproxy.com/register?page=ecommerce-scraping-api%2Fpricing\u0026utm_source=socialorganic\u0026utm_medium=social\u0026utm_campaign=github_ecommerce_scraper\"\u003e\n        \u003cimg src=\"https://i.imgur.com/v707ui6.png\" alt=\"Smartproxy eCommerce Scraping API\"\u003e\n    \u003c/a\u003e\n\u003c/p\u003e\n\n\u003cp align=\"center\"\u003e\n    \u003ca href=\"https://discord.gg/sCr34yVDVB\"\u003e\n        \u003cimg src=\"https://dcbadge.vercel.app/api/server/gvJhWJPaB4\" alt=\"Discord\"\u003e\n    \u003c/a\u003e\n    \u003cimg src=\"https://img.shields.io/badge/API-v2-blue\" alt=\"API Version\"\u003e\n    \u003cimg src=\"https://img.shields.io/badge/License-MIT-green\" alt=\"License\"\u003e\n\u003c/p\u003e\n\n## 🚀 Overview\n\nThe **eCommerce Scraping API** by Smartproxy enables developers to extract comprehensive product data from major eCommerce platforms including Amazon and Wayfair. Our API provides structured, reliable data extraction with high success rates and built-in parsing capabilities.\n\n### ✨ Key Features\n\n- **Multi-platform Support**: Amazon, Wayfair, and generic eCommerce sites\n- **Comprehensive Data**: Products, reviews, pricing, Q\u0026A, and search results\n- **AI-Powered Parsing**: Intelligent data extraction for any eCommerce site\n- **Global Coverage**: Support for multiple locales and geographical locations\n- **High Performance**: Fast response times with reliable uptime\n- **Developer Friendly**: RESTful API with extensive documentation and examples\n\n## 📋 Table of Contents\n\n- [Quick Start](#-quick-start)\n- [Authentication](#-authentication)\n- [Supported Platforms](#-supported-platforms)\n  - [Amazon](#amazon)\n  - [Wayfair](#wayfair)\n  - [Generic eCommerce](#generic-ecommerce)\n- [API Reference](#-api-reference)\n- [Code Examples](#-code-examples)\n- [Response Codes](#-response-codes)\n- [Support](#-support)\n\n## 🚀 Quick Start\n\n### Prerequisites\n\n- Active eCommerce Scraping API subscription\n- Valid API credentials (username/password)\n\n### Basic Request\n\n```bash\ncurl -X POST https://scraper-api.smartproxy.com/v2/scrape \\\n  -H \"Content-Type: application/json\" \\\n  -u \"username:password\" \\\n  -d '{\n    \"target\": \"amazon\",\n    \"url\": \"https://www.amazon.com/dp/B09H74FXNW\"\n  }'\n```\n\n## 🔐 Authentication\n\nAuthentication is handled via HTTP Basic Auth using your Smartproxy credentials.\n\n1. Navigate to your [Smartproxy Dashboard](https://dashboard.smartproxy.com)\n2. Go to **eCommerce \u003e Authentication**\n3. Enter your username and password\n4. Generate and test your API request\n\n\u003e **Note**: The dashboard provides example requests with preset values. Customize parameters in your actual implementation.\n\n## 🛍️ Supported Platforms\n\n### Amazon\n\nExtract comprehensive data from Amazon including products, reviews, pricing, and search results.\n\n#### Available Targets\n\n| Target | Description | Parseable | Required Parameter |\n|--------|-------------|-----------|-------------------|\n| `amazon` | Product page via URL | ✅ | `url` |\n| `amazon_product` | Product via ASIN | ✅ | `query` |\n| `amazon_pricing` | Pricing information | ✅ | `query` |\n| `amazon_reviews` | Product reviews | ✅ | `query` |\n| `amazon_questions` | Q\u0026A section | ✅ | `query` |\n| `amazon_search` | Search results | ✅ | `query` |\n| `amazon_bestsellers` | Bestseller lists | ✅ | `query` |\n\n#### Example Response Structure\n\n\u003cdetails\u003e\n\u003csummary\u003eClick to expand Amazon product response\u003c/summary\u003e\n\n```json\n{\n  \"results\": [\n    {\n      \"content\": {\n        \"url\": \"https://www.amazon.com/dp/B09H74FXNW\",\n        \"asin\": \"B09H74FXNW\",\n        \"title\": \"Gaming Headset with Microphone...\",\n        \"price\": 20.98,\n        \"currency\": \"USD\",\n        \"rating\": 4.4,\n        \"reviews_count\": 2239,\n        \"images\": [\"https://m.media-amazon.com/images/...\"],\n        \"description\": \"Product description...\",\n        \"bullet_points\": \"Key features...\",\n        \"category\": [...],\n        \"variations\": [...],\n        \"ads\": [...]\n      },\n      \"status_code\": 200,\n      \"created_at\": \"2022-09-01 11:03:48\"\n    }\n  ]\n}\n```\n\n\u003c/details\u003e\n\n### Wayfair\n\nAccess Wayfair product data and search results.\n\n#### Available Targets\n\n| Target | Description | Parseable | Required Parameter |\n|--------|-------------|-----------|-------------------|\n| `wayfair` | Product page via URL | ❌ | `url` |\n| `wayfair_search` | Search results | ❌ | `query` |\n\n### Generic eCommerce\n\nExtract data from any eCommerce website using our AI-powered parser.\n\n#### Target Configuration\n\n| Target | Description | Parseable | Required Parameter |\n|--------|-------------|-----------|-------------------|\n| `ecommerce` | Any eCommerce site | ✅ (AI) | `url` |\n\n\u003e **Note**: For AI parsing, set `parse: true` and `parser_type: \"ecommerce_product\"`\n\n## 📖 API Reference\n\n### Base URL\n```\nhttps://scraper-api.smartproxy.com/v2/scrape\n```\n\n### Request Parameters\n\n| Parameter | Type | Required | Description |\n|-----------|------|----------|-------------|\n| `target` | string | ✅ | Scraping target (see [supported targets](#supported-platforms)) |\n| `url` | string | * | Direct URL to scrape |\n| `query` | string | * | Search query or product ID |\n| `locale` | string | ❌ | Interface language (e.g., `en-US`, `en-GB`) |\n| `geo` | string | ❌ | Geographical location |\n| `device_type` | string | ❌ | Device type: `desktop`, `mobile`, `tablet` |\n| `headless` | string | ❌ | JavaScript rendering: `html`, `png` |\n| `parser_type` | string | ❌ | Parser type for eCommerce target |\n\n*Required parameter depends on the target\n\n### Device Types\n\n- `desktop` (default)\n- `desktop_chrome`\n- `desktop_firefox`\n- `mobile`\n- `mobile_android`\n- `mobile_ios`\n\n## 💻 Code Examples\n\n### Python\n\n```bash\ncurl https://raw.githubusercontent.com/Smartproxy/eCommerce-Scraping-API/main/python/amazon.py \u003e amazon.py\n```\n\n### PHP\n\n```bash\ncurl https://raw.githubusercontent.com/Smartproxy/eCommerce-Scraping-API/main/php/amazon.php \u003e amazon.php\n```\n\n### Node.js\n\n```bash\ncurl https://raw.githubusercontent.com/Smartproxy/eCommerce-Scraping-API/main/nodejs/amazon.js \u003e amazon.js\n```\n\n### Complete Example Collection\n\n| Platform | Python | PHP | Node.js |\n|----------|--------|-----|---------|\n| Amazon Product | [amazon.py](https://github.com/Smartproxy/eCommerce-Scraping-API/blob/main/python/amazon.py) | [amazon.php](https://github.com/Smartproxy/eCommerce-Scraping-API/blob/main/php/amazon.php) | [amazon.js](https://github.com/Smartproxy/eCommerce-Scraping-API/blob/main/nodejs/amazon.js) |\n| Amazon Search | [amazonsearch.py](https://github.com/Smartproxy/eCommerce-Scraping-API/blob/main/python/amazonsearch.py) | [amazonsearch.php](https://github.com/Smartproxy/eCommerce-Scraping-API/blob/main/php/amazonsearch.php) | [amazonsearch.js](https://github.com/Smartproxy/eCommerce-Scraping-API/blob/main/nodejs/amazonsearch.js) |\n| Amazon Reviews | [amazonreviews.py](https://github.com/Smartproxy/eCommerce-Scraping-API/blob/main/python/amazonreviews.py) | [amazonreviews.php](https://github.com/Smartproxy/eCommerce-Scraping-API/blob/main/php/amazonreviews.php) | [amazonreviews.js](https://github.com/Smartproxy/eCommerce-Scraping-API/blob/main/nodejs/amazonreviews.js) |\n| Wayfair | [wayfair.py](https://github.com/Smartproxy/eCommerce-Scraping-API/blob/main/python/wayfair.py) | [wayfair.php](https://github.com/Smartproxy/eCommerce-Scraping-API/blob/main/php/wayfair.php) | [wayfair.js](https://github.com/Smartproxy/eCommerce-Scraping-API/blob/main/nodejs/wayfair.js) |\n| Generic eCommerce | [ecommerce.py](https://github.com/Smartproxy/eCommerce-Scraping-API/blob/main/python/ecommerce.py) | [ecommerce.php](https://github.com/Smartproxy/eCommerce-Scraping-API/blob/main/php/ecommerce.php) | [ecommerce.js](https://github.com/Smartproxy/eCommerce-Scraping-API/blob/main/nodejs/ecommerce.js) |\n\n## 📊 Response Codes\n\n### HTTP Status Codes\n\n| Code | Status | Description | Action Required |\n|------|--------|-------------|-----------------|\n| **200** | ✅ Success | Request completed successfully | Continue processing |\n| **204** | ⏳ Processing | Job still in progress | Wait and retry |\n| **400** | ❌ Bad Request | Invalid request format | Check request structure |\n| **401** | 🔒 Unauthorized | Invalid credentials | Verify authentication |\n| **403** | 🚫 Forbidden | Access denied | Check subscription/permissions |\n| **404** | 🔍 Not Found | Target not found | Verify URL/parameters |\n| **429** | ⚡ Rate Limited | Too many requests | Wait before retrying |\n| **500** | 🔧 Server Error | Internal server error | Contact support |\n| **524** | ⏰ Timeout | Request timeout | Retry after delay |\n\n### Parser Status Codes\n\n| Code | Status | Description |\n|------|--------|-------------|\n| **12000** | ✅ Success | Data parsed successfully |\n| **12002** | ❌ Parse Failed | Complete parsing failure |\n| **12003** | 🚫 Not Supported | Target not supported |\n| **12004** | ⚠️ Incomplete | Some fields missing |\n| **12005** | ⚠️ Partial | Some fields unparsed |\n| **12006** | 🔧 Error | Unexpected error occurred |\n| **12007** | ❓ Unknown | Parse status unclear |\n| **12008** | ❌ Failed | Failed to parse data |\n| **12009** | 🔍 Not Found | Target parameters invalid |\n\n## 🧪 Testing\n\n### Postman Collection\n\n[![Run in Postman](https://run.pstmn.io/button.svg)](https://app.getpostman.com/run-collection/23304112-92a123e7-171c-497e-8ca1-57eff04361f3?action=collection%2Ffork\u0026collection-url=entityId%3D23304112-92a123e7-171c-497e-8ca1-57eff04361f3%26entityType%3Dcollection%26workspaceId%3D52705bab-433c-4fbf-afce-ccbfc97430fe)\n\nImport our comprehensive Postman collection to test all API endpoints with pre-configured examples.\n\n## 🆘 Support\n\n### Documentation \u0026 Resources\n\n- 📚 [Full API Documentation](https://smartproxy.com/scraping/ecommerce)\n- 🎯 [Dashboard](https://dashboard.smartproxy.com)\n\n### Getting Help\n\n1. **Check Documentation**: Review this README and our full documentation\n2. **Community Support**: Join our Discord for community help\n3. **Technical Issues**: Contact our support team with your task ID\n4. **Feature Requests**: Submit via GitHub issues\n\n### Rate Limits \u0026 Best Practices\n\n- Monitor your request quota in the dashboard\n- Implement exponential backoff for retries\n- Cache responses when appropriate\n- Use appropriate `device_type` for your use case\n\n## 📄 License\n\nThis project is licensed under the [MIT License](./LICENSE).\n\n---\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdanieladdisonorg%2Fecommerce-scraping-api","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fdanieladdisonorg%2Fecommerce-scraping-api","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdanieladdisonorg%2Fecommerce-scraping-api/lists"}