https://github.com/arham09/python-anime-scraper

Python Scraper for anime videos
https://github.com/arham09/python-anime-scraper

python scrapy

Last synced: about 1 month ago
JSON representation

Python Scraper for anime videos

• Host: GitHub
• URL: https://github.com/arham09/python-anime-scraper
• Owner: arham09
• Created: 2018-12-24T18:51:31.000Z (over 7 years ago)
• Default Branch: master
• Last Pushed: 2019-01-18T08:11:58.000Z (over 7 years ago)
• Last Synced: 2025-12-13T02:50:59.201Z (7 months ago)
• Topics: python, scrapy
• Language: Python
• Size: 1.08 MB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

          
# Python-Anime-Scraper

Scrapping for animeisme

## Requirement

### Prerequisites

- Python - Download and Install [Python](https://www.python.org/)

- Pip - Download and Install [Pip](https://pypi.org/project/pip/) 

```

  $ pip install -r requirements.txt

```

## Run Program

Run command to starts scraping

**Start application**

```

$ cd folder

$ scrapy crawl 

```

## Spider

1. animeupdate (For daily update scrapping)

## Insert to DB

### 1. Manual Insert

uncomment code from line 68 - 85

```

scrapy crawl animeupdate -o anime.csv

```

Scrapy will automatically generate csv file and insert to DB

### 2. API Insert

Using request library, create insert api to automatically insert to db