Project

fluent-plugin-tcp_mc

0.0
No release in over 3 years
Low commit activity in last 3 years
fluent-plugin-tcp_mcparticle-man/fluent-plugin-tcp_mcHomepageDocumentationSource CodeBug TrackerWiki
Purpose built plugin for fluentd to send json over tcp.
2005
2006
2007
2008
2009
2010
2011
2012
2013
2014
2015
2016
2017
2018
2019
2020
2021
2022
2023
2024
2025
 Popularity
Downloads
4,784
Stars
0
Forks
0
Watchers
1
 Releases
Current version
0.2.0
Total releases
2
First release
2017-04-20
Latest release
2018-10-24
 Pull Requests
Open Pull Requests
0
Closed Pull Requests
2
Merged Pull Requests
5
Pull Request Acceptance Rate
71%
 Development
Primary Language
Ruby
Licenses
Apache-2.0
Average date of last 50 commits
2021-04-11
Reverse Dependencies
0

 Dependencies

Development

bundler
~> 1.14
rake
~> 12.0
test-unit
~> 3.0

Runtime

fluentd
< 2, >= 0.14.10
 Project Readme

fluent-plugin-tcp_mc

Gem Version CI Anchore CVE Scan

Fluentd output plugin to send JSON-formatted logs to generic TCP endpoints.

Features

  • Multi-worker support - Efficiently handles high-volume log streams
  • Automatic failover - Cycles through multiple configured servers on connection failure
  • Configurable timeouts - Fine-tune connection and send timeouts
  • Modern Fluentd API - Built on the latest Fluentd plugin architecture
  • Production-ready - Used in production environments

This plugin was inspired by the rawtcp output from Uken Games.

Installation

RubyGems

$ gem install fluent-plugin-tcp_mc

Bundler

Add following line to your Gemfile:

gem "fluent-plugin-tcp_mc"

And then execute:

$ bundle

Configuration

Basic Configuration

Add this to your Fluentd configuration file:

<match pattern>
  @type tcp_mc

  # Connection timeouts
  connect_timeout 5s    # Time to wait for connection (default: 5s)
  send_timeout 60s      # Time to wait for send operation (default: 60s)

  # Server configuration
  <server>
    host 192.168.1.100
    port 5000
    name primary-server  # Optional friendly name
  </server>

  # Optional: Add multiple servers for failover
  <server>
    host 192.168.1.101
    port 5000
    name backup-server
  </server>

  # Buffer configuration
  <buffer tag>
    @type memory
    flush_interval 10s
    retry_type exponential_backoff
    retry_wait 1s
    retry_max_interval 60s
  </buffer>
</match>

Configuration Options

Parameter Type Default Description
connect_timeout time 5s Maximum time to wait for TCP connection
send_timeout time 60s Maximum time to wait for send operation

Server Block

Parameter Type Required Description
host string Yes Hostname or IP address of the TCP endpoint
port integer Yes Port number of the TCP endpoint
name string No Friendly name for the server (defaults to "host:port")

Examples

See the examples/ directory for complete configuration examples.

Development Roadmap

Potential future enhancements:

  • Async writes for improved performance
  • Support for additional output formats (key-value, msgpack, etc.)
  • Connection pooling and keep-alive support
  • Custom formatter support
  • Compression support (gzip, zstd)
  • TLS/SSL encryption support

Contributions welcome! See CONTRIBUTING.md for guidelines.

Development & Release

  • CI/CD: Automated testing on multiple Ruby versions (2.7-3.3)
  • Security: Weekly Anchore CVE scans with GitHub Security integration
  • Releases: Automated publishing to RubyGems via GitHub Actions
  • Documentation: Comprehensive examples and test suite

For maintainers releasing new versions, see RELEASING.md.

Copyright

  • Copyright(c) 2017-2025 David Pippenger
  • License
    • Apache License, Version 2.0

Acknowledgements

Inspired by the rawtcp plugin by Uken Games

https://github.com/uken/fluent-plugin-out_rawtcp