A simply web crawler.

Easy way to enable AdSense crawler to login and see private or custom pages in your rails application. Basically one custom login filter. Gem enables you to easily slightly increase revenues from Google AdSense/AdWords. It makes it easy to enable crawling on private pages and so get better target...

A simple web crawler gem

A simple news crawler. You can specify the structure of your xml or rss feeds.

a simple web crawler using DSL of capybara

A simple web crawler gem

Generic Web crawler with a DSL that parses event-related data from web pages

This gem is a web crawler sample code.So I don't reccmmend that you use.

web crawler that generates a sitemap to a neo4j database. It will also store broken_links and total number of pages on site

Simple ruby web crawler

A crappy crawler for crashlytics

Crawler for http://legendas.tv to see the most dowloaded subtitles

A simple web crawler gem

Jobs crawler

A periodic crawler that fetches the latest CVE additions, parses them, and filters them

A demo of Web Crawler using arb-crawler

MurmuringSpider is a concise Twitter crawler. When we write a data-mining / text-mining application based on twitter timeline, we have to collect and store tweets first. I am irritated with writing such crawler repeatedly, so I wrote this. What you have to do is only to add query and to run th...

The Baidu Crawler is to crawl data with your demmand

This crawler will use my personnal scraper named 'RecipeScraper' to dowload recipes data from Marmiton, 750g or cuisineaz

Crawler for downloading comics from komiks.gildia.pl