Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/xtream1101/scrape-itebooks
Site does not have downloads anymore, repo is not kept up to date atm.
https://github.com/xtream1101/scrape-itebooks
Last synced: about 1 month ago
JSON representation
Site does not have downloads anymore, repo is not kept up to date atm.
- Host: GitHub
- URL: https://github.com/xtream1101/scrape-itebooks
- Owner: xtream1101
- Archived: true
- Created: 2015-10-27T15:04:53.000Z (about 9 years ago)
- Default Branch: master
- Last Pushed: 2016-09-21T17:31:06.000Z (over 8 years ago)
- Last Synced: 2024-08-08T23:24:30.512Z (5 months ago)
- Language: Python
- Homepage:
- Size: 15.6 KB
- Stars: 51
- Watchers: 13
- Forks: 19
- Open Issues: 1
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# scrape-itebooks
Developed using Python 3.4
Scrape the site https://it-ebooks.info/ and save all the books on the site. Currently does not backfill but will keep up with the latest uploads
*I am working on a way to backfill all of the data.
Must pass in a config file like so: `python3 it-ebooks.py -c ~/scrapers.conf`
See what the conf file needs to contain here: https://git.eddyhintze.com/xtream1101/scraper-lib
This scraper also requires this section in the config:
```
[it-ebooks]
# `scraper_key` is only needed if `scraper-monitor` is enabled
scraper_key =
```## Setup
Run `pip3 install -r requirements.txt`