Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/firaskahlaoui/amazon-scraper
The Amazon Scraper automates the process of gathering and comparing prices for CPU, GPU, and RAM products from Amazon.
https://github.com/firaskahlaoui/amazon-scraper
python scrapy web-scraping
Last synced: about 5 hours ago
JSON representation
The Amazon Scraper automates the process of gathering and comparing prices for CPU, GPU, and RAM products from Amazon.
- Host: GitHub
- URL: https://github.com/firaskahlaoui/amazon-scraper
- Owner: FirasKahlaoui
- Created: 2024-05-27T13:31:22.000Z (6 months ago)
- Default Branch: master
- Last Pushed: 2024-06-23T21:09:42.000Z (5 months ago)
- Last Synced: 2024-06-23T22:24:37.913Z (5 months ago)
- Topics: python, scrapy, web-scraping
- Language: Python
- Homepage:
- Size: 2.54 MB
- Stars: 8
- Watchers: 2
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# Amazon Scraper
This project is an Amazon scraper that collects daily data on CPU, GPU, and RAM prices. It includes a proxy scraper to ensure reliable data retrieval and compares the current prices with those from the previous day.
## About This Project
The Amazon Scraper automates the process of gathering and comparing prices for CPU, GPU, and RAM products from Amazon. By running the scraper daily, it provides up-to-date price information and tracks price changes over time.
## Features
- **Amazon Scraping**: Collects product data for CPU, GPU, and RAM from Amazon daily.
- **Proxy Scraping**: Gathers and uses proxies to avoid IP blocking and ensure reliable data retrieval.
- **Price Comparison**: Compares current prices with prices from the previous day to identify changes.## Topics
- Web Scraping
- Proxy Management
- Data Processing
- Automation
- Python
- BeautifulSoup
- Requests## Installation
Clone the repository and install the required dependencies:
```bash
git clone https://github.com/FirasKahlaoui/amazon-scraper.git
cd amazon-scraper
pip install -r requirements.txt