Ruby web crawler to access omelete informations

Multithreaded web crawler with transparent DSL and requests caching.

Allows to crawl bandcamp sites, including release and track information

Pantopoda is a web crawler that visits all links on a given domain that's fast and effective.