0.01
No commit activity in last 3 years
No release in over 3 years
A dumper to download whole galleries from board like 4chan, imagebam, mangaeden, deviantart, etc.
2005
2006
2007
2008
2009
2010
2011
2012
2013
2014
2015
2016
2017
2018
2019
2020
2021
2022
 Dependencies

Development

~> 1.6
~> 10.3
~> 3.1

Runtime

~> 0.4
~> 1.0
~> 1.0
~> 1.8
~> 1.6
= 1.1.4, ~> 1.1
= 0.19.1, ~> 0.19
~> 0.1
 Project Readme

Dumper

A dumper to download whole image galleries of the most popular boards (aka, those I care). It's modular, so you can add a website just putting its module in lib/dumper/profiles.

If you wish to use a graphical user interface, you can use DumperUI.

Install

$ gem install image-dumper

Profiles

Profiles are the scripts that handle the dump of a website. They are divided in the following types and are useful to understand how to give them the --from and --to parameters.

  • images A page containing a bunch of images. You can choose how many images it has to dump.
  • pages You can choose how many pages it has to dump and you will get all the images present on each page.
  • chapters It will dump a specific chapter of a manga.

Moreover, you can set how many threads you want to provide the dumper with --threads MIN:MAX.

Examples

$ dumper --list # list profiles

$ dumper --help # show the help and all the available commands

$ dumper --info 4chan # show all the info available for the given profile

$ dumper --url "http://boards.4chan.org/wg/res/5280736" --path images --threads 1:4

$ dumper --url "http://www.mangaeden.com/en-manga/nisekoi" --path nisekoi --from 3 --to 9

$ dumper --url "http://www.mangaeden.com/en-manga/nisekoi" --path nisekoi --from 10 --to 10 --output nisekoi.log --profile mangaeden

$ dumper --file stuff.txt --silence # dump all the lines formatted in the "URL||PATH" way