Project

waluigi

0.0
No commit activity in last 3 years
No release in over 3 years
A set of abstractions that facade ruby code in luigi tasks running in python
2005
2006
2007
2008
2009
2010
2011
2012
2013
2014
2015
2016
2017
2018
2019
2020
2021
2022
2023
2024
 Dependencies

Runtime

~> 1.0, >= 1.0.3
 Project Readme

Waluigi

Gem Version PyPI version

With the power of pycall and some metaprogramming magic is possible to facade a ruby class into a luigi task. Not everything works, but looks promising.

Instalation

Waluigi is divided into 2 packages, a ruby gem and a python egg. You need to install both in order to be able to use waluigi.

gem install waluigi
pip install waluigi-facade

Usage

Write a Tasksfile like the one provided here, then use the waluigi binary for running the tasks. The binary will take the arguments and will pass them verbatim to luigi.

For example:

waluigi MyTask --local-scheduler

What works

  • Executing the run method
  • Declaring outputs defined in Python code
  • Declaring requirements programmed either in Ruby or Python
  • Parameters declaration in Ruby
  • Getting information from the Python side (output(), input(), parameters, etc)

What doesn't

  • Utility classes: WrapperTask, ExternalTask, etc