Allows to crawl bandcamp sites, including release and track information

This will be crawling data from websites. Need to give the xpaths clearly. Will be updating with new functionalities in future

BFS webcrawler that implements Observable

Driller is a command line Ruby based web crawler based on Anemone. Driller can crawl website and reports error pages and slow pages and generates HTML reports.

FileCrawler searches and controls files in local directory

RegexpCrawler is a Ruby library for crawl data from website using regular expression.

Gem for crawling data from external sources

Mobile App Review Crawler

A little website crawler.

A crawler for a single domain web application

A ruby stock price & option chain crawler

Iudex is a general purpose web crawler and feed processor in ruby/java. This gem is an rjack-async-httpclient based implementation of the iudex-http interfaces.

Iudex is a general purpose web crawler and feed processor in ruby/java. The iudex-http-test gem contains a HTTP test server for testing HTTP client implementations.

株価情報を取得してあれこれするライブラリ

A web scrawler to get a Marmiton's recipe

A gem that collects mangas from websites

Add support for ElasticSearch in Polipus crawler

This is web comic crawler that Akihabara otaku.

Crawl websites

Add support for Cassandra in Polipus crawler