Grab the movies information from the atmovies.com

This gem allows to crawl news articles from RSS feeds.

Iudex is a general purpose web crawler and feed processor in ruby/java. The iudex-worker gem provides a worker deamon for feed/page processing.

Crawl websites

A web crawler written in ruby

Friendly, neighborhood web crawler for quality assurance.

Crawler that auto generates SitePrism Page Objects

book's price crawler

Ruby Web crawler

A ruby social media stat crawler

Using paperclip to generate images from sensible attributes like e-mails and telephone numbers, in order to reduce crawler's success