out_kafka
Output plugin writes records into Apache Kafka. This document doesn't describe all parameters. If you want to know full features, check the Further Reading section.out_kafka
is included in td-agent2 after v2.3.3. Fluentd gem users will need to install the fluent-plugin-kafka gem using the following command.kafka_buffered
.json
, ltsv
, msgpack
, attr:<record name>
, <formatter name>
. msgpack
is recommended since it's more compact and faster.gzip
and snappy
. When you use snappy
, you need to install snappy
gem by td-agent-gem
command.memory
by default (buf_memory) for the ease of testing, however file
(buf_file) buffer type is always recommended for the production deployments. If you use file
buffer type, buffer_path
parameter is required.max_retry_wait
is reached.retry_limit
parameter for details), the sleep interval can be up to approximately 131072 seconds (roughly 36 hours) in the default configurations.retry_limit
is ignored and there is no limit). The default values are 17 and false (not disabled). If the limit is reached, buffered data is discarded and the retry interval is reset to its initial value (retry_wait
).20.0
seconds. Note that parameter type is float
, not time
.log_level
option allows the user to set different levels of logging for each plugin. The supported log levels are: fatal
, error
, warn
, info
, debug
, and trace
.