https://github.com/kenmwaura1/py-amazon-scraper

This is an amazon.com web scraper for laptop prices utilizing python and the scrapy framework
https://github.com/kenmwaura1/py-amazon-scraper

Last synced: 17 days ago
JSON representation

This is an amazon.com web scraper for laptop prices utilizing python and the scrapy framework

• Host: GitHub
• URL: https://github.com/kenmwaura1/py-amazon-scraper
• Owner: KenMwaura1
• License: mit
• Created: 2022-11-05T14:57:01.000Z (almost 3 years ago)
• Default Branch: main
• Last Pushed: 2024-10-17T08:38:49.000Z (12 months ago)
• Last Synced: 2025-09-15T09:55:36.814Z (22 days ago)
• Language: Python
• Size: 495 KB
• Stars: 7
• Watchers: 1
• Forks: 1
• Open Issues: 1
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

          

# Python Amazon Scraper

[![Python package](https://github.com/KenMwaura1/py-amazon-scraper/actions/workflows/pythonpackage.yml/badge.svg)](https://github.com/KenMwaura1/py-amazon-scraper/actions/workflows/pythonpackage.yml)

This project utilizes the Scrapy framework to scrape [amazon]() for data. Currently, it retrieves laptop data(name, price and discount). However you can configure this as needed.

![Data Screenshot](images/amazon_data-pgadmin.png)

[![MIT License](https://img.shields.io/badge/License-MIT-green.svg)](https://choosealicense.com/licenses/mit/)

## Tech Stack

**Database:** Postgres DB

**Server:** Python, Scrapy

## Run Locally

Clone the project

```bash

  git clone https://github.com/KenMwaura1/py-amazon-scraper

```

Go to the project directory

```bash

  cd py_amazon_scraper

```

Install dependencies

```bash

  pip Install -r requirements

```

Change into the project directory

```bash

  cd amz_scraper

```

Start the spider

```bash

  scrapy crawl amznspider

```

## License

[MIT](https://choosealicense.com/licenses/mit/)

## Feedback

If you have any feedback, please reach out to me at kemwaura@gmail.com

## Authors

- [@KenMwaura1](https://github.com/KenMwaura1)