So, you've got a sitemap.xml, and you want a hierarchal representation of the URLs within, right? Well, here's your huckleberry.

Siteseeker integration library

Scrape content from a website.

Ruby interface for the Sitethree advertising platform including the requesting of ads

A tool that extracts and combines text from HTML files into a single, streamlined markdown document. It provides a command-line interface for easy usage, removes unnecessary HTML elements to reduce token usage, and creates an easily uploadable format for AI tools like Claude AI or ChatGPT. The tool preserves document structure and includes frontmatter metadata.

U.S. Patent and Trademark Office parsing helpers

Makes life easy for who wants to get the bus schedule from SJC website

Slownik Jezyka Polskiego

Tool that extracts links from serienjunkies.org

Skates is a framework to create EventMachine based XMPP External Components in Ruby.

Tool for fast generating multi language page objects from iOS (device/simulator) and Android (devices/emulator) screens.

build SVG images

A Ruby DSL for testing REST APIs.

SkiPlan API client gem

Uses data from OnTheSnow.com to provide snow reports

API like interface to provide information about books available at Skoob.

A cute little DSL for picking information off of web pages.

Datamining Bot

Easy to use DSL that helps scraping data from websites. Thanks to it, writing web crawlers would be very fast and intuitive. Traversing through html nodes and fetching all of the HTML attributes, would be possible. Just like in jQuery - you will find methods like parent, children, first, find, siblings etc. Furthermore, you are able to download images, web pages, and store all content in the database. Please visit my Github account for more details.

Check for broken links on a website