Install by RPM Package (Red Hat Linux)
This article explains how to install stable versions of fluent-package
rpm packages, the stable Fluentd distribution packages maintained by Fluentd Project and calyptia-fluentd
which is maintained by Calyptia, Inc..
What is fluent-package
?
fluent-package
?Fluentd is written in Ruby for flexibility, with performance-sensitive parts in C. However, some users may have difficulty installing and operating a Ruby daemon.
That is why Fluentd Project provides the stable distribution of Fluentd, called fluent-package
(formerly known as td-agent
). The differences between Fluentd and fluent-package
can be found here.
What is calyptia-fluentd
?
calyptia-fluentd
?Our Calyptia also knows that Fluentd is written in Ruby for flexibility, with performance-sensitive parts in C. However, some users may have difficulty installing and operating a Ruby daemon. And td-agent
is still seated on Ruby 2.7 due to compatibility reasons and Ruby versioning policy, calyptia-fluentd
uses Ruby 3 instead of Ruby 2.7 for now.
That is why Calyptia, Inc. provides the alternative stable distribution of Fluentd, called calyptia-fluentd
. The differences between td-agent
and calyptia-fluentd
are bundled and running Ruby versions for now.
This installation guide is for fluent-package
v5 and calyptia-fluentd
v1. fluent-package
v5 and calyptia-fluentd
use fluentd v1 in the core. See fluent-package-v5-vs-td-agent or td-agent-v2-vs-v3-vs-v4 for the comparison and supported OS.
Using to install fluent-package
fluent-package
NOTE:
About deprecated Treasure Agent (td-agent) v4 (EOL), See Install by RPM Package v4.
About deprecated Treasure Agent (td-agent) 3 will not be maintained anymore, see Install by DEB Package v3.
fluent-package
will be shipped in two flavors - normal release version and LTS (Long Term Support) version. See Scheduled support lifecycle announcement about Fluent Package about difference between this two flavors.If you upgrade from
td-agent
v4, See Upgrade to fluent-package v5.Do not directly upgrade from v3 to v5. Such a workflow is not supported. It causes a trouble. Upgrade in stages. (v3 to v4, then v4 to v5)
Step 0: Before Installation
Please follow the Pre-installation Guide to configure your OS properly.
Step 1: Install from rpm
Repository
rpm
RepositoryIt is highly recommended to set up ntpd
on the node to prevent invalid timestamps in the logs. See Pre-installation Guide.
NOTE: If your OS is not supported, consider gem installation instead.
Red Hat
Download and execute the install script with curl
:
fluent-package 5 (LTS)
fluent-package 5
Executing this script will automatically install fluent-package
on your machine. This shell script registers a new rpm
repository at /etc/yum.repos.d/fluent-package.repo
(or /etc/yum.repos.d/fluent-package-lts.repo
) and installs fluent-package
.
We use $releasever
for repository path in the script and $releasever
should be the major version only like "9"
. If your environment uses some other format like "9.2"
, change it to the major version only or set up .repo file manually.
Since v5.0.4, RHEL 7 / CentOS 7 is not supported anymore because CentOS 7 has reached EOL (June, 2024). Please consider migrating to another release.
Amazon Linux
For Amazon Linux 2023:
fluent-package 5 (LTS)
fluent-package 5
For Amazon Linux 2:
fluent-package 5 (LTS)
fluent-package 5
Step 2: Launch Daemon
Use /usr/lib/systemd/system/fluentd
service to start
, stop
, or restart
the agent:
To customize systemd
behavior, put your fluentd.service
in /etc/systemd/system
.
NOTE: In fluent-package
v5, the path is different i.e. /opt/fluent/bin
instead of /opt/td-agent/bin
.
Step 3: Post Sample Logs via HTTP
The default configuration (/etc/fluent/fluentd.conf
) is to receive logs at an HTTP endpoint and route them to stdout
. For fluentd
logs, see /var/log/fluent/fluentd.log
.
You can post sample log records with curl
command:
Using to install calyptia-fluentd
calyptia-fluentd
Step 0: Before Installation
Please follow the Pre-installation Guide to configure your OS properly.
Step 1: Install from rpm
Repository
rpm
RepositoryIt is highly recommended to set up ntpd
on the node to prevent invalid timestamps in the logs. See Pre-installation Guide.
NOTE: If your OS is not supported, consider gem installation instead.
Red Hat / CentOS
Download and execute the install script with curl
:
Executing this script will automatically install calyptia-fluentd
on your machine. This shell script registers a new rpm
repository at /etc/yum.repos.d/Calyptia-Fluentd.repo
and installs calyptia-fluentd
.
We use $releasever
for repository path in the script and $releasever
should be the major version only like "7"
. If your environment uses some other format like "7.2"
, change it to the major version only or set up TD repository manually.
CentOS Stream
For CentOS Stream 8:
Amazon Linux
For Amazon Linux 2:
Step 2: Launch Daemon
calyptia-fluentd
only provides systemd's unit file:
systemd
systemd
Use /usr/lib/systemd/system/calyptia-fluentd
script to start
, stop
, or restart
the agent:
To customize systemd
behavior, put your calyptia-fluentd.service
in /etc/systemd/system
.
Please make sure your configuration file path is:
Step 3: Post Sample Logs via HTTP
The default configuration (/etc/calyptia-fluentd/calyptia-fluentd.conf
) is to receive logs at an HTTP endpoint and route them to stdout
. For calyptia-fluentd
logs, see /var/log/calyptia-fluentd/calyptia-fluentd.log
.
You can post sample log records with curl
command:
Next Steps
You are now ready to collect real logs with Fluentd. Refer to the following tutorials on how to collect data from various sources:
Basic Configuration
For further steps, follow these:
If this article is incorrect or outdated, or omits critical information, please let us know. Fluentd is an open-source project under Cloud Native Computing Foundation (CNCF). All components are available under the Apache 2 License.
Last updated