This crawler will use my personnal scraper named 'RecipeScraper' to dowload recipes data from Marmiton, 750g or cuisineaz

Fake User-Agents of about %80 of real devices to use in headers of web crawlers. It keeps your script away from being nested by many UA strings.

Samao is a web crawler written in ruby.

Web page crawler.

A demo of Web Crawler using arb-crawler

Friendly, neighborhood web crawler for quality assurance.

The application crawls a URL and extracts links, tags and sequences. These features are written to an output file

a simple web crawler using DSL of capybara

Show DMM and DMM.R18's crawled data. e.g. ranking

Crawler that auto generates SitePrism Page Objects

A simply web crawler.

Multithreaded web crawler with transparent DSL and requests caching.

Web crawler to get courses from XML pages at mymav.uta

Gem para acessar os dados do TIA Mackenzista

This file crawler helps to decect if there are new files in a directory.

Stupid crawler that looks for URLs on a given site. Result is saved as two CSV files one with found URLs and another with failed URLs.

This gem allows to crawl news articles from RSS feeds.

Crawls the mails in a IMAP Folder

A simple crawler to list SESC events schedule on Terminal

ActiveRecord adapter for kudzu crawler