Hot Potato is an open source real-time processing framework written in Ruby. Originally designed to process the Twitter firehose at 3,000+ tweets per second, it has been extended to support any type of streaming data as input or output to the framework. The framework excels with applications such as, social media analysis, log processing, fraud prevention, spam detection, instant messaging, and many others that include the processing of streaming data.

A buffered log backed by Apache Kafka.

This gem is a Logstash plugin required to be installed on top of the Logstash core pipeline using $LS_HOME/bin/logstash-plugin install gemname. This gem is not a stand-alone program

Memcached store that will compress all entries using snappy

Server for handling metrics from metriks

Reporter component for the metriks metrics library to report to a metriks server

Mongoid Snappy

ReportsMash agent for rails applications.

Event Store driver

Sequel driver for Sandthorn

A small collection of filters for use with Skeevy

Watch and tail files with specified time based patterns and push them to kafka

Waits for logging messages and forwards them further

Imports Wikipedia dumps to a local database and lets you browse them from the commandline or with a local sinatra server.