Fluentd has eight (8) types of plugins:
This article gives an overview of the Parser Plugin.
<parse> directive for input plugins (e.g.
in_udp) cannot parse the user's custom data format (for example, a context-dependent grammar that can't be parsed with a regular expression). To address such cases, Fluentd has a pluggable system that enables the user to create their own parser formats.
Write a custom format plugin. See here
for more information.
From any input plugin that supports the
<parse> directive, call the custom
plugin by its name.
Here is an example to read Nginx access logs using
<source>@type tailpath /path/to/input/file<parse>@type nginxkeep_time_key true</parse></source>
If you are familiar with
grok-parser plugin is useful. Use
> 1.0.0 versions for
If you need to parse multiple formats in one data stream,
multi-format-parser is useful.
For protocol buffers.
Following plugins support
If this article is incorrect or outdated, or omits critical information, please let us know. Fluentd is an open-source project under Cloud Native Computing Foundation (CNCF). All components are available under the Apache 2 License.