CUI tool to archive URIs using web.archive.org, archive.today, and others

A web crawler dsl.

Simple Web Invoice Downloader

Allow to deploy projects from webistrano via console

Webmaster Tools extends the official API to give programmatically access to various crawl information and functions which are available via the webinterface

Compress all css file in specified dir with yuicompressor

This gem checks whether a webpage is updated. By HTTP header or hash (MD5, SHA256...) differences, this gem inspects whether the page is updated or not.

A web scraper using Webrat & Mechanize

A command line app packaged as a ruby gem that allows users to search a website for specific terms.

Webspinne analyzes websites by counting their pages.

auto tag social people

Fetch the web pages and stat.

The Webtractor library can extract main content from websites like news, blogs, etc without unwanted boilerplate (menus, footer, comments)

Enable Whiplash batches api with email/password

scrapes creepy subreddits and submits takedown requests for found imgur pics

WHMCS API gem

auto tag social people

What companies are using what technologies

An automatically login tool for a public wireless LAN.

wiki data fetch gem