out_kafka2is included in
td-agent. Fluentd gem users will need to install the
fluent-plugin-kafkagem using the following command:
$ fluent-gem install fluent-plugin-kafka
# list of seed brokers
# buffer settings
# data type settings
# topic settings
# producer settings
Please see the Configuration File article for the basic structure and syntax of the configuration file.
Please make sure that you have enough space in the buffer path directory. Running out of disk space is a problem frequently reported by users.
The value must be
The list of all seed brokers, with their host and port information.
The field name for the target topic. If the field value is
app, this plugin writes events to the
This field name must be included in the buffer chunk keys:
<buffer category> # topic_key should be included in buffer chunk key
The name of the default topic. (default:
This value will be used when the
topic_keyfield is missing.
The format of each message. The available options are
ltsv, and formatter plugins.
Here is the
Set fluentd event time to Kafka's
false(It means the current time.)
The number of acks required per request.
The codec the producer uses to compress messages (default:
snappy, you need to install
@log_leveloption allows the user to set different levels of logging for each plugin.
Supported log levels:
For common output / buffer parameters, please check the following articles:
This page does not describe all the possible configurations. If you want to know about other configurations, please check the link below:
If this article is incorrect or outdated, or omits critical information, please let us know. Fluentd is an open-source project under Cloud Native Computing Foundation (CNCF). All components are available under the Apache 2 License.