Edamame combines the Beanstalk priority queue with a Tokyo Tyrant database and God monitoring to produce a persistent distributed priority job queue system. Like beanstalk, it is fast, lightweight, distributed, priority queuing, reliable scheduling; it adds persistence, named jobs and job query...

A simple scraper for directed scrapes of APIs, feed or structured HTML. Plays nicely with wuclan and wukong.

The Infochimps Platform is an end-to-end, managed solution for building Big Data applications. It integrates best-of-breed technologies like Hadoop, Storm, Kafka, MongoDB, ElasticSearch, HBase, &c. and provides simple interfaces for accessing these powerful tools. Computation, analy...

Treat your dataset like a: * stream of lines when it's efficient to process by lines * stream of field arrays when it's efficient to deal directly with fields * stream of lightweight objects when it's efficient to deal with objects Wukong is friends with Hadoop the elephan...

Clusta is a Ruby library that implements network algorithms using Wukong. This means you can use and extend these algorithms on your laptop and seamlessly lift them into a Hadoop cluster when you're ready.

Facade adapting apis to activity streams spec

Massive-scale social network analysis. Nothing to f with.

Lets you load data from the command-line into data stores like * Elasticsearch * MongoDB * HBase * MySQL * Kafka and others.

Storm processing for Ruby