https://github.com/roxasshadow/dumper
A dumper to download whole galleries from boards like 4chan, yandere, mangaeden, deviantart, etc.
https://github.com/roxasshadow/dumper
Last synced: 12 months ago
JSON representation
A dumper to download whole galleries from boards like 4chan, yandere, mangaeden, deviantart, etc.
- Host: GitHub
- URL: https://github.com/roxasshadow/dumper
- Owner: RoxasShadow
- License: gpl-3.0
- Created: 2013-04-10T20:49:06.000Z (over 13 years ago)
- Default Branch: master
- Last Pushed: 2018-12-07T11:42:03.000Z (over 7 years ago)
- Last Synced: 2024-08-08T15:39:15.696Z (almost 2 years ago)
- Language: Ruby
- Homepage:
- Size: 146 KB
- Stars: 23
- Watchers: 4
- Forks: 2
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
Dumper
======
A dumper to download whole image galleries of the most popular boards (aka, those I care).
It's modular, so you can add a website just putting its module in lib/dumper/profiles.
If you wish to use a graphical user interface, you can use [DumperUI](https://github.com/RoxasShadow/DumperUI).
Install
-------
`$ gem install image-dumper`
Profiles
--------
Profiles are the scripts that handle the dump of a website.
They are divided in the following types and are useful to understand how to give them the `--from` and `--to` parameters.
- `images` A page containing a bunch of images. You can choose how many images it has to dump.
- `pages` You can choose how many pages it has to dump and you will get all the images present on each page.
- `chapters` It will dump a specific chapter of a manga.
Moreover, you can set how many threads you want to provide the dumper with `--threads MIN:MAX`.
Examples
--------
`$ dumper --list # list profiles`
`$ dumper --help # show the help and all the available commands`
`$ dumper --info 4chan # show all the info available for the given profile`
`$ dumper --url "http://boards.4chan.org/wg/res/5280736" --path images --threads 1:4`
`$ dumper --url "http://www.mangaeden.com/en-manga/nisekoi" --path nisekoi --from 3 --to 9`
`$ dumper --url "http://www.mangaeden.com/en-manga/nisekoi" --path nisekoi --from 10 --to 10 --output nisekoi.log --profile mangaeden`
`$ dumper --file stuff.txt --silence # dump all the lines formatted in the "URL||PATH" way`