Fluentd has eight (8) types of plugins:
This article gives an overview of the Parser Plugin.
<parse> directive for input plugins (e.g.
in_udp) cannot parse the user's custom data format (for example, a context-dependent grammar that can't be parsed with a regular expression). To address such cases, Fluentd has a pluggable system that enables the user to create their own parser formats.
Write a custom format plugin. See here
for more information.
From any input plugin that supports the
<parse> directive, call the custom
plugin by its name.
Here is an example to read Nginx access logs using
<source>@type tailpath /path/to/input/file<parse>@type nginxkeep_time_key true</parse></source>
If you are familiar with
grok-parser plugin is useful. Use
> 1.0.0 versions for
If you need to parse multiple formats in one data stream,
multi-format-parser is useful.
For protocol buffers.
For Apache Avro.
Following plugins support
If this article is incorrect or outdated, or omits critical information, please let us know. Fluentd is an open-source project under Cloud Native Computing Foundation (CNCF). All components are available under the Apache 2 License.