https://github.com/rajabzz/digikala-crawler

🕷️ A crawler to collect comments and product information on digikala.com
https://github.com/rajabzz/digikala-crawler

Last synced: 3 months ago
JSON representation

🕷️ A crawler to collect comments and product information on digikala.com

• Host: GitHub
• URL: https://github.com/rajabzz/digikala-crawler
• Owner: rajabzz
• License: mit
• Archived: true
• Created: 2018-09-27T13:02:02.000Z (about 6 years ago)
• Default Branch: master
• Last Pushed: 2023-02-07T21:53:11.000Z (almost 2 years ago)
• Last Synced: 2024-06-27T12:31:01.439Z (5 months ago)
• Language: Python
• Homepage:
• Size: 20.5 KB
• Stars: 47
• Watchers: 4
• Forks: 10
• Open Issues: 7
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# digikala-crawler

[![HitCount](http://hits.dwyl.io/rajabzz/digikala-crawler.svg)](http://hits.dwyl.io/rajabzz/digikala-crawler)

[![Maintainability](https://api.codeclimate.com/v1/badges/8ec7c2370e5823d0a025/maintainability)](https://codeclimate.com/github/rajabzz/digikala-crawler/maintainability)

[![contributions welcome](https://img.shields.io/badge/contributions-welcome-brightgreen.svg?style=flat)](https://github.com/dwyl/esta/issues)

>🕷️ A crawler to collect comments and product information on digikala.com

## Installation

Install `Python` and `pip`. Then:

```bash

$ git clone https://github.com/rajabzz/digikala-crawler.git

$ cd digikala-crawler

$ pip install -r requirements.txt

```

## Running The Crawler

The following command runs the `comment` spider and saves the output in the `results.jl` file.

```bash

$ scrapy crawl comment -o results.jl 

```

## License

This project is licensed under the MIT License - see the [LICENSE](LICENSE) file for details