Retrieves a list of URLs to seed the crawler by publishing them to a RabbitMQ exchange.

Jobs crawler

Email crawler: crawls the top ten Google search results looking for email addresses and exports them to CSV.

This gem is a web crawler sample code.So I don't reccmmend that you use.

Crawler for http://legendas.tv to see the most dowloaded subtitles

A periodic crawler that fetches the latest CVE additions, parses them, and filters them

Web crawler with JSON-based DSL and EventMachine-powered page fetching

MurmuringSpider is a concise Twitter crawler. When we write a data-mining / text-mining application based on twitter timeline, we have to collect and store tweets first. I am irritated with writing such crawler repeatedly, so I wrote this. What you have to do is only to add query and to run th...

a crawler toolkit

A simple web crawler gem

A crappy crawler for crashlytics

Crawler Guru provides all basic functionalities to extract data from web pages

This crawler will use my personnal scraper named 'RecipeScraper' to dowload recipes data from Marmiton, 750g or cuisineaz

A very simple crawler for RubyGems.org used to demo the power of ElasticSearch at RubyConf 2013

crawler of niconico

This file crawler helps to decect if there are new files in a directory.

Simple Gem Using Watir For Phantom Crawler

A demo of Web Crawler using arb-crawler

A simple web crawler gem

Asynchronous web crawler, scraper and file harvester