Aquanaut creates a sitemap dynamically based on a given domain.

Get a list of available domains 1 bit away from a given domain

CLI for build.io

Checks a user agent for a web crawler

Ruby gem and command-line utility for conversion of DOI metadata from and to different metadata formats, including schema.org. Fork of version 1.19.12 of the bolognese gem.

This summary is a summary of a summary

Contentful CLI tool for getting started with Contentful

Cookiejar of greed is an implementation of cookiejar focused on browser compatibility and loosely based on the standard.

Ruby wrapper for the Demandbase API

Command line tool to package IPUMS DOI extracts

Gem for parsing domain of url

domain name validator includes JP domain

Apartment integration as a plugin for Ekylibre

A feed posts aggregator for rss and facebook pages

FHCAP Command Line Tool

Url and Mail string parsers.

Look up Forbes 2000 companies based on a domain name or email address

Generate dnsmasq ipset configure file from gfwlist

Fetch Google Seller Rating

Retrieves a list of URLs to seed the crawler by publishing them to a RabbitMQ exchange.