https://github.com/atishaytuli07/web-scraping
Fetch E-Commerce site, Flipkart product details including Title, Price, Desscription and other details in just one click - using python library Beautiful Soup, Flask.
https://github.com/atishaytuli07/web-scraping
amazon flask-application flipkart python python-project webscraping
Last synced: 7 months ago
JSON representation
Fetch E-Commerce site, Flipkart product details including Title, Price, Desscription and other details in just one click - using python library Beautiful Soup, Flask.
- Host: GitHub
- URL: https://github.com/atishaytuli07/web-scraping
- Owner: atishaytuli07
- Created: 2023-08-26T09:30:16.000Z (over 2 years ago)
- Default Branch: main
- Last Pushed: 2024-11-21T14:37:32.000Z (over 1 year ago)
- Last Synced: 2025-02-23T01:44:27.987Z (about 1 year ago)
- Topics: amazon, flask-application, flipkart, python, python-project, webscraping
- Language: Jupyter Notebook
- Homepage:
- Size: 14.6 MB
- Stars: 1
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# Flipkart & Amazon Web Scraping Tool 🛒
## Description
The Flipkart & Amazon Web Scraping Tool is a web application built with HTML, CSS, JavaScript, and Python (using Flask). It allows users to search for products based on keywords and scrape product details such as title, price, ratings, number of reviews, and purchase links from Flipkart and Amazon.
This tool is ideal for e-commerce researchers, developers, or anyone looking to compare prices, product features, or gather insights from online retailers.
## Features
- Product Search: Users can search for products by entering keywords.
- Product Details: Retrieves and displays product information including:
Title
Price
Ratings
Number of Reviews
Purchase Links
- Web Scraping: Uses BeautifulSoup to scrape product data from Flipkart and Amazon.
- Error Handling: Handles errors such as invalid queries or connection issues.
- Dynamic Interface: Displays results in a responsive and user-friendly design
---
## Technologies Used
- **Frontend**: HTML, CSS, JavaScript
- **Backend**: Python (Flask Framework)
- **Web Scraping**: BeautifulSoup
- **Data Handling**: Python's `os` module and `requests` library
- **Database**: MongoDB (for optional data storage)
- **logging**: For tracking errors and monitoring scraping activities or data persistence.
---
## How to Run the Project
### Prerequisites
- **Python 3.6+** installed on your system.
- Basic knowledge of terminal/command line.
- Install the required Python libraries:
```bash
pip install flask flask-cors requests beautifulsoup4 pymongo
#### STEP 01 : Clone this repository
git clone
cd flipkart-amazon-scraping-tool
#### STEP 02: Set up a virtual environment (optional but recommended)
python3 -m venv myenv
source myenv/bin/activate # On Windows, use myenv\Scripts\activate
#### STEP 03: Ensure the project folder has the following structure
AMAZON-SCRAPING/
├── app.py
├── templates/
│ ├── index.html
│ ├── result.html
│ ├── about_us.html
│ ├── contact_us.html
├── static/
│ ├── many images
├── venv
├── Flipcart_Scraping.ipynb
Notes
Ensure that the tool complies with the Terms of Service for both Flipkart and Amazon when using it for data scraping.
You can customize the tool to scrape additional data or include more product categories by modifying the scraping logic.
#### STEP 04: Run the Flask application
```bash
python app.py