https://github.com/jagtaprathmesh19/amazon-data-scraper-project

https://github.com/jagtaprathmesh19/amazon-data-scraper-project

Last synced: about 1 month ago
JSON representation

• Host: GitHub
• URL: https://github.com/jagtaprathmesh19/amazon-data-scraper-project
• Owner: jagtaprathmesh19
• Created: 2022-06-02T13:16:41.000Z (over 2 years ago)
• Default Branch: master
• Last Pushed: 2023-07-08T07:14:02.000Z (over 1 year ago)
• Last Synced: 2024-12-07T18:32:13.103Z (about 2 months ago)
• Language: HTML
• Size: 435 KB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# Amazon-Data-Scraper-Project

## Description

The main objective of this project is to scrape data or collect data from websites in a structured format. This data is used to do data analysis and take a decision which puts some good results for the amazon. This project is for learning purposes. 

I Used **Requests**. **BeautifulSoup** modules to make connection with url and fetch data using their tags and attributes. And finally i save all data in CSV file using 

**Pandas Framework**.

### This Project Contain Three Python Files :

1. **scraper.py** : This is our main file which connects the URL by using the requests module and downloading the request page. Then we use BeautifulSoup to fetch Categories and their URLs. 

2. **page_scraper.py** : It contains all the functions which are used to fetch all categories pages.

3. **data_scraper** : This file also contains functions which used to scrape product data like `Product Description`, `Product category`, `Product Price`, `Product Reviews`, `Product Reviews`, and `Product Urls`.

## How to use :

#### Amazon-Data-Scraper Use me