Project

gina-conveyor

0.0
No commit activity in last 3 years
No release in over 3 years
gina-conveyorgina-alaska/conveyorHomepageDocumentationSource CodeBug TrackerWiki
Conveyor is used for shuffling data around
2005
2006
2007
2008
2009
2010
2011
2012
2013
2014
2015
2016
2017
2018
2019
2020
2021
2022
2023
2024
 Popularity
Downloads
32,265
Stars
1
Forks
0
Watchers
19
 Releases
Current version
1.0.1
Total releases
12
First release
2012-05-24
Latest release
2015-09-28
 Pull Requests
Open Pull Requests
0
Closed Pull Requests
1
Merged Pull Requests
4
Pull Request Acceptance Rate
80%
 Development
Primary Language
Ruby
Average date of last 50 commits
2014-02-06
Reverse Dependencies
0

 Dependencies

Development

rake
>= 0

Runtime

activemodel
~> 4.1.0
activesupport
~> 4.1.0
em-websocket
~> 0.5.1
eventmachine
~> 1.0.0
listen
~> 2.10
mixlib-shellout
~> 2.2.1
rainbow
~> 2.0.0
rb-readline
~> 0.5.0
 Project Readme

Conveyor

Start of a thought on some code to handle moving data around when it shows up on various systems

Installation

Using rubygems

gem install gina-conveyor

From source

git clone https://github.com/gina-alaska/conveyor.git
cd conveyor
rake install

Usage

Just run the executable to start the conveyor process. Currently since no daemon mode is available it's best to start conveyor in a screen/tmux session

$ screen conveyor
[2012-05-24 13:39:52 -0800] Starting Conveyor v0.0.2
[2012-05-24 13:39:52 -0800] Loading workers from /home/wfisher/.workers
[2012-05-24 13:39:52 -0800] Waiting for files
[2012-05-24 13:39:52 -0800] Press CTRL-C to stop
[2012-05-24 13:39:52 -0800] Starting websocket on 0.0.0.0:9876

Configuration

On the first run conveyor will create a .conveyor file with all the default options.

  • worker_defs - directory where worker definition files live
  • logfile - location where global log output will be saved
  • threadpool - how many threads will be kept available to run workers.
  • command_timeout (seconds) - number of seconds that a command will execute before being terminated. Default: 600 (10 minutes).
  • websocket - alternate status monitoring (deprecated)
  • campfie - alternate status notification (deprecated)
  • version - version of the conveyor script used to generate the config file. New versions of conveyor will automatically update the config file with new options as they are added. Previously defined or deprecated options will not be changed.

Todo

  1. Add daemon mode
  2. Document worker syntax
  3. Finish email notifications
  4. Add additional cli options

Worker Commands

run 'COMMAND', [options]

Runs the specified command in a shell

Options

  • quite (boolean) - suppress any output from the command, default: false
  • timeout (seconds) - the command stop execution after give number of seconds, default: 600 (10 minutes)

scp 'FILE', 'DESTINATION', [options]

SCP the specified file to a remote DESTINATION. DESTINATION uses the same format as the actual scp command.

Options

  • quite (boolean) - suppress any output from the command, default: false
  • timeout (seconds) - the command stop execution after give number of seconds, default: 600 (10 minutes)

WARNING: You will need to have ssh/scp'd to the host manually once in order to ensure that the host key and ssh keys are available for this command.

copy 'FILE', 'DESTINATION'

Copy the specified file to DESTINATION. DESTINATION can be a folder or another filename

move 'FILE', 'DESTINATION'

Move the specified file to DESTINATION. DESTINATION can be a folder or another filename

delete 'FILE'

Deletes the specified file

error 'MESSAGE', info 'MESSAGE'

Print info out to various log files and consoles

License

See LICENSE file for licensing and credits. Think BSD/MIT.