https://github.com/rahulkrsharma2004/athlead-assignment
A web scraper built to extract detailed product information from any Smart TV listing on Amazon India. This tool captures key product details, pricing, offers, customer reviews, and images for a structured and comprehensive overview.
https://github.com/rahulkrsharma2004/athlead-assignment
axios cors css3 expressjs html5 mern-stack nodejs puppeteer react-icons react-router reactjs tailwindcss
Last synced: 2 months ago
JSON representation
A web scraper built to extract detailed product information from any Smart TV listing on Amazon India. This tool captures key product details, pricing, offers, customer reviews, and images for a structured and comprehensive overview.
- Host: GitHub
- URL: https://github.com/rahulkrsharma2004/athlead-assignment
- Owner: Rahulkrsharma2004
- Created: 2025-03-21T12:27:30.000Z (over 1 year ago)
- Default Branch: main
- Last Pushed: 2025-03-24T12:37:37.000Z (about 1 year ago)
- Last Synced: 2025-07-16T08:45:59.160Z (11 months ago)
- Topics: axios, cors, css3, expressjs, html5, mern-stack, nodejs, puppeteer, react-icons, react-router, reactjs, tailwindcss
- Language: JavaScript
- Homepage: https://amazon-web-scraper-psi.vercel.app
- Size: 162 KB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# AthLead-Assignment
# 🛍️ Amazon India Smart TV Web Scraper
This project is a **fully functional web scraper** that extracts **detailed product information** from **Smart TV listings** on **Amazon India**. Using **Puppeteer**, it fetches data such as product name, price, discounts, bank offers, ratings, reviews, and images.
The extracted data is then displayed in an **Amazon-like UI**, built with **React.js** and **Tailwind CSS**. This tool helps users analyze product details efficiently **without manually browsing Amazon**.
## 🚀 Features
✔️ **Scrapes Key Product Details** – Product Name, Rating, Price, Number of Ratings
✔️ **Captures Discounts & Bank Offers** – Fetches total discount & banking deals
✔️ **Extracts "About This Item" & "Product Information"** – All technical details included
✔️ **Collects Amazon Product Images** – Fetches images from the product page (excluding videos)
✔️ **Extracts "From the Manufacturer" Images** – Retrieves images from the manufacturer section
✔️ **AI-Generated Customer Review Summary** – Captures Amazon’s AI-generated insights
✔️ **User-Friendly UI** – Displays extracted data in a clean, Amazon-like interface
✔️ **Optimized for Performance** – Efficient and fast scraping using Puppeteer
## 📸 Preview
## 🛠️ Tech Stack
### 🔹 **Frontend**
- **React.js** – Component-based UI development
- **Tailwind CSS** – Utility-first styling framework
- **React Icons** – For attractive UI icons
### 🔹 **Backend**
- **Node.js** – JavaScript runtime for server-side logic
- **Express.js** – Fast, unopinionated web framework
- **Puppeteer** – Headless Chrome browser for web scraping
### 🔹 **Data Handling**
- **Axios** – For API calls
- **JSON** – Stores and structures scraped data
### 🔹 **Deployment & Dev Tools**
- **Vercel** – Frontend deployment
- **Vercel** – Backend hosting options
- **GitHub** – Version control and collaboration
- **ESLint & Prettier** – Code quality and formatting
- **Thunderclient** – API testing
## ⚡ Getting Started
### 1️⃣ Clone the Repository
```bash
git clone https://github.com/Rahulkrsharma2004/AthLead-Assignment.git
cd Backend-Scraper
cd Frontend-Scraper