No commit activity in last 3 years
No release in over 3 years
Fetch file from Qingstor as the input of logstash
2005
2006
2007
2008
2009
2010
2011
2012
2013
2014
2015
2016
2017
2018
2019
2020
2021
2022
2023
2024
 Dependencies

Development

Runtime

 Project Readme

Logstash Output Plugin for QingStor

English | 中文

As an input plugin, it can download the log files from QingStor, and read them into logstash.
QingStor is a remarkable object storage service provided by QingCloud.

For now, We've submitted this plugin to rubygems.org. Use the following command to install.

$ bin/logstash-plugin install logstash-input-qingstor

If want to install the local code, please refer to the following guide to install it manually.

Simplified Chinese version README can be found here

1. Configuration Guide

1.1 Run in minimal Configuration Settings

input {
    qingstor {
        access_key_id => 'your_access_key_id'           #required 
        secret_access_key => 'your_secret_access_key'   #required  
        bucket => 'bucket_name'                         #required 
        # region => "pek3a"                             #optional, default value "pek3a"                                
    }
}

More configuration details please refer to common options.

2. Running your unpublished Plugin in Logstash

2.1 Run in a local Logstash clone

  • Edit Logstash Gemfile and add the local plugin path, for example:
$ gem "logstash-input-qingstor", :path => "/your/local/logstash-input-qingstor"
  • Install plugin
$ bin/logstash-plugin install --no-verify
  • Run Logstash with your plugin
$ bin/logstash -e "input { \
      qingstor { \
          access_key_id => 'your_access_key_id' \
          secret_access_key => 'your_secret_access_key' \
          bucket => 'bucket_name' \
      } \
  }"

At this point any modifications to the plugin code will be applied to this local Logstash setup. After modifying the plugin, simply rerun Logstash.

2.2 Run in an installed Logstash

You can use the same 2.1 method to run your plugin in an installed Logstash by editing its Gemfile and pointing the :path to your local plugin development directory or you can build the gem and install it using:

  • Build your plugin gem
$ gem build logstash-input-qingstor.gemspec
  • Install the plugin from the Logstash home
$ bin/logstash-plugin install /your/local/plugin/logstash-input-qingstor.gem
  • Start Logstash and proceed to test the plugin

Contributing

Please see Contributing Guidelines of this project before submitting patches.

LICENSE

The Apache License (Version 2.0, January 2004).