If things are not happening as expected, please first look at your logs. For
td-agent (rpm/deb), the logs are located at
You can get more information about the logs if verbose logging is turned on. Please follow the steps below:
See the logging article also.
Put your unit file into
/etc/systemd/system/td-agent. This overwrites the existing behavior of
[Service]ExecStart=...existing options... -vv
-vv to TD_AGENT_OPTIONS
# at /etc/init.d/td-agent...TD_AGENT_OPTIONS="... -vv"...
This approach does not work on
systemd environment because
init.d's start routine and ignore other options.
-vv to your command line:
$ fluentd .. -vv
Fluentd uses SIGDUMP for dumping fluentd internal information to local file, e.g. thread dump, object allocation, etc. If you have a problem with fluentd like process hang, please send
SIGCONT to fluentd parent and child processes.
fluentd suddenly hits unexpected high CPU usage problem, there are several reasons:
a plugin has a race condition or similar bug
dependent gems have a bug
regular expression with broken data
system calls has a bug, e.g.
inotify with lots of files
You sometimes hit unexpected shutdown with non-zero exit status like this:
2016-01-01 00:00:00 +0800 [info]: starting fluentd-0.12.282016-01-01 00:00:00 +0800 [info]: reading config file path="/etc/td-agent/td-agent.conf"[...snip...]2016-01-01 00:00:02 +0800 [info]: process finished code=6
If the problem happens inside Ruby e.g. segmentation fault, C extension bug, etc., you cannot get the complete log when fluentd process is daemonized. For example,
td-agent launches fluentd with
--daemon option. In
td-agent case, you can get the complete log with following command to simulate
/etc/init.d/td-agent start without daemonize:
$ sudo LD_PRELOAD=/opt/td-agent/embedded/lib/libjemalloc.so /usr/sbin/td-agent -c /etc/td-agent/td-agent.conf --user td-agent --group td-agent
If this article is incorrect or outdated, or omits critical information, please let us know. Fluentd is an open-source project under Cloud Native Computing Foundation (CNCF). All components are available under the Apache 2 License.