{"id":26873593,"url":"https://github.com/satvikx/amzn-web-scraper","last_synced_at":"2025-07-31T14:18:37.147Z","repository":{"id":285352406,"uuid":"957826719","full_name":"satvikx/Amzn-Web-Scraper","owner":"satvikx","description":"This project is a web scraper designed to extract product details from Amazon product pages using BeautifulSoup.","archived":false,"fork":false,"pushed_at":"2025-03-31T07:47:37.000Z","size":0,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-03-31T08:30:54.572Z","etag":null,"topics":["beautifulsoup","python","scraper","web"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/satvikx.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2025-03-31T07:42:45.000Z","updated_at":"2025-03-31T07:47:40.000Z","dependencies_parsed_at":"2025-03-31T08:41:00.796Z","dependency_job_id":null,"html_url":"https://github.com/satvikx/Amzn-Web-Scraper","commit_stats":null,"previous_names":["satvikx/amzn-web-scraper"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/satvikx%2FAmzn-Web-Scraper","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/satvikx%2FAmzn-Web-Scraper/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/satvikx%2FAmzn-Web-Scraper/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/satvikx%2FAmzn-Web-Scraper/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/satvikx","download_url":"https://codeload.github.com/satvikx/Amzn-Web-Scraper/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":246443534,"owners_count":20778252,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["beautifulsoup","python","scraper","web"],"created_at":"2025-03-31T09:19:35.167Z","updated_at":"2025-03-31T09:19:35.760Z","avatar_url":"https://github.com/satvikx.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"\n# Amazon Products Scraper (using BeautifulSoup)\n**This project is a web scraper designed to extract product details from Amazon product pages using Python and the BeautifulSoup library. The scraper fetches information such as product name, price, ratings, reviews, images, and other relevant details. The extracted data is saved in both JSON and CSV formats for further analysis or use.**\n\n## Features\n- Extracts product details such as:\n  - Product name\n  - Price and discounts\n  - Ratings and number of reviews\n  - Product description and specifications\n  - Images \n  - Bank offers and promotional details\n- Saves the extracted data in:\n  - `amazon_product.json` (structured JSON format)\n  - `amazon_product.csv` (tabular format for easy analysis)\n- Handles dynamic user-agent headers to avoid detection.\n- Modular and object-oriented design for better maintainability.\n\n\n## Setup\n\n[**Note** - I use uv as python package manager and Git Bash as default terminal]\n1. Create Virtual Environment `uv venv venv`.\n2. Activate Environment `source venv/Scripts/activate`.\n3. Install Dependencies `uv pip install -r requirements.txt`.\n4. Insert the product url in `main.py` file.\n5. Run using `python main.py`.\n6. Results are saved in [amazon_product.csv](amazon_product.csv) and [amazon_product.json](amazon_product.json). ","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fsatvikx%2Famzn-web-scraper","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fsatvikx%2Famzn-web-scraper","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fsatvikx%2Famzn-web-scraper/lists"}