This gem crawls the latest CircleCI artifact file you specified. For Example, you can get the result JSON of simplecov.gem etc.

Hushes worthless Rails exceptions & logs, such as those caused by bots and crawlers.

With just a few lines of code, developers can effortlessly integrate this gem into their projects, enabling seamless retrieval of page titles from HTML documents. Whether you're building web scrapers, crawlers, or any application that requires fetching webpage titles, WebTitle streamlines the pro...

A simple ruby gem to recursively traverse all URLs on a Root URL. It returns all the URLs it encountered

A simple movie converter, queue and directory crawler, all in one!

Botch is a DSL for quickly creating web crawlers. Inspired by Sinatra.

book's price crawler

A simple crawler that gets posts and pages from wordpress websites that have an exposed api

Mobile App Review Crawler

A little website crawler.

Cangrejo lets you consume crabfarm crawlers using a simple DSL

A crawler for a single domain web application

Show DMM and DMM.R18's crawled data. e.g. ranking

Iudex is a general purpose web crawler and feed processor in ruby/java. The iudex-filter gem contains a fundamental filtering/chain of responsbility sub-system.

Lightweight web crawler

Headless HTTP crawler/scraper

株価情報を取得してあれこれするライブラリ

Simple little website crawler.

A web scrawler to get a Marmiton's recipe

A gem that collects mangas from websites