Fluentd
Search…
secondary_file
The
out_secondary_file Output plugin writes chunks to files. This plugin is similar to out_file but this is for <secondary> use-case.NOTE: Do not use this plugin for the primary plugin.
out_secondary_file is included in Fluentd's core.Example Configuration
1
<match pattern>
2
@type forward
3
# ...
4
<secondary>
5
@type secondary_file
6
directory /var/log/fluentd/error
7
</secondary>
8
</match>
Copied!
With this configuration, failed buffer chunks are saved into
/var/log/fluentd/error/dump.bin.N, N is 0-origin incremental number.Please see the Configuration File article for the basic structure and syntax of the configuration file.
Plugin Helpers
No helpers.
Parameters
@type (required)
@type (required)The value must be
secondary_file.directory
directorytype
default
version
string
required parameter
1.0.0
The directory path of the output file. Received buffer chunks are saved in this directory.
1
<secondary>
2
@type secondary_file
3
directory /var/log/fluentd/error
4
</secondary>
Copied!
basename
basenametype
default
version
string
dump.bin
1.0.0
The basename of the output file. You can use
${chunk_id} placeholder to identify the original chunk.1
<secondary>
2
@type secondary_file
3
directory /var/log/fluentd/error
4
basename dump.${chunk_id}
5
</secondary>
Copied!
The output path would be:
1
# 59c278456e74a22dc594b06a7d4247c4 is chunk id
2
/var/log/fluentd/error/dump.59c278456e74a22dc594b06a7d4247c4.0
Copied!
append
appendtype
default
version
bool
false
1.0.0
Determines that the received chunk is appended to an existing file or not. By default, it is not appended and each chunk is flushed to a different path:
1
# append false
2
dump.bin.0
3
dump.bin.1
4
dump.bin.2
5
...
6
dump.bin.N
Copied!
This makes parallel file processing easy. But if you want to disable this behavior, you can disable it by setting
append true:1
# append true
2
dump.bin
Copied!
How to resend secondary file
The secondary file can be resend by
fluent-cat command.Here is the example to resend
dump.bin.0 to 127.0.0.1:24224 using fluent-cat.1
$ cat /path/to/dump.bin.0 | fluent-cat --format msgpack --host 127.0.0.1 --port 24224 TAG
Copied!
If this article is incorrect or outdated, or omits critical information, please let us know. Fluentd is an open-source project under Cloud Native Computing Foundation (CNCF). All components are available under the Apache 2 License.
Last modified 11mo ago