No commit activity in last 3 years
No release in over 3 years
Encodes LZ4 files for other file output plugins.
2005
2006
2007
2008
2009
2010
2011
2012
2013
2014
2015
2016
2017
2018
2019
2020
2021
2022
2023
2024
2025
2026
 Dependencies

Development

~> 1.0
>= 10.0
 Project Readme

Lz4 encoder plugin for Embulk

This plugin is embulk file encoder for LZ4, a Extremely fast compression algorithm.

Caution! : This plugin supports LZ4 Frame Format only!

LZ4 Frame Format is the most famously format for compressing file of any size by LZ4. if you use Linux, lz4 program has generating a compressed file formatted by LZ4 Frame Format.

then, this plugin is not supported other formats based on LZ4 algorithm such as raw LZ4 Block Format, currently.

Overview

  • Plugin type: encoder

Configuration

  • block_size: Block Maximum Size for uncompressed buffer. you can choose from 65535, 262144, 1048576 or 4194304. (integer, default: 4194304)

Example

out:
  type: any output input plugin type
  encoders:
    - type: lz4
      block_size: 4194304

Build

$ ./gradlew gem  # -t to watch change of files and rebuild continuously