Empower World Travel Information Technology

Empower World Travel Information Technology

Empower World Travel Information Technology

webget gem - a web (go get) crawler incl. web cache

rails_angular_seo allows you to make your single-page apps (Backbone, Angular, etc) built on Rails SEO-friendly. It works by injecting a small rack middleware that will render pages as plain html, when the requester is one of the most common crawlers/bots out there (Google, Yahoo Baidu and Bing)

s7o crawler optimized for programmer happiness and sustainable productivity.

This gem crawls the latest CircleCI artifact file you specified. For Example, you can get the result JSON of simplecov.gem etc.

Arachnidish is a web crawler that relies on Bloom Filters to efficiently store visited urls and Typhoeus to avoid the overhead of Mechanize when crawling every page on a domain.

Hushes worthless Rails exceptions & logs, such as those caused by bots and crawlers.

This gem helps Crawler Writers to interact with the PromoQui REST API

With just a few lines of code, developers can effortlessly integrate this gem into their projects, enabling seamless retrieval of page titles from HTML documents. Whether you're building web scrapers, crawlers, or any application that requires fetching webpage titles, WebTitle streamlines the pro...

Using paperclip to generate images from sensible attributes like e-mails and telephone numbers, in order to reduce crawler's success

BFS webcrawler that implements Observable

A simple crawler that gets posts and pages from wordpress websites that have an exposed api

A crappy crawler for a crappy bank interface

Crawls the mails in a IMAP Folder

Mobile App Review Crawler

Cangrejo lets you consume crabfarm crawlers using a simple DSL

A crawler for a single domain web application

A ruby stock price & option chain crawler