PigSpec

PigSpec is an extention for rspec testing framework for Apache Pig. This extention can execute pig script with customize input relation data, and can get output relation data in ruby easily.

PigSpec uses Pig and PigUnit. Thus, install Pig and PigUnit first.

Second. install gem of pigspec.

If you using bundle, You write Gemfile to

gem 'pigspec'

And then execute:

$ bundle

Or install it yourself as:

$ gem install pigspec

First: write a test case in your rspec code. Sample:

require 'pigspec'
include PigSpec

describe 'SamplePigTest' do
  it 'sample test' do
    actual = pig do
      script <<-EOS
        in = LOAD 'inputfile' AS (query:chararray);
        out = LIMIT in 1;
        STORE out INTO 'outputfile';
      EOS
      with_args 'n=2'
      override 'in', %w(hoge hoge hoge)
      pickup 'out'
    end
    expect(actual).to eq([['hoge']])
  end
end

pig returns pickuped alias datas.

Readed datatype are following:

Second: Set environment variable PIG_HOME to Your pig installed directory, And Run.

export PIG_HOME=<your pig installed dir>
spec

1. Fork it ( https://github.com/shiracha/pigspec/fork )
2. Create your feature branch (git checkout -b my-new-feature)
3. Commit your changes (git commit -am 'Add some feature')
4. Push to the branch (git push origin my-new-feature)
5. Create a new Pull Request