The Fluent::Logger library is used to post records from Perl applications to Fluentd.

This article explains how to use it.

Prerequisites

• Basic knowledge of Perl

• Basic knowledge of Fluentd

• Perl 5.10 or higher

Installing Fluentd

Please refer to the following documents to install fluentd:

• ​Install Fluentd with rpm Package​

• ​Install Fluentd with deb Package​

• ​Install Fluentd with Ruby Gem​

• ​Install Fluentd from source​

Modifying the Config File

Configure Fluentd to use the forward input plugin as its data source:

<source>
  @type forward
  port 24224
</source>
<match fluentd.test.**>
  @type stdout
</match>

Restart agent after configuring.

# for rpm/deb only
$ sudo /etc/init.d/td-agent restart
​
# or systemd
$ sudo systemctl restart td-agent.service

Using Fluent::Logger

Install Fluent::Logger library via CPAN:

$ cpan
cpan[1]> install Fluent::Logger

Create a script to post the records:

# test.pl
use Fluent::Logger;
my $logger = Fluent::Logger->new(
    host => '127.0.0.1',
    port => 24224,
    tag_prefix => 'fluentd.test',
);
$logger->post("follow", { "entry1" => "value1", "entry2" => 2 });

Executing the script will send the logs to Fluentd:

$ perl test.pl

The logs should be output to /var/log/td-agent/td-agent.log or the standard output of the Fluentd process via stdout output plugin.

Production Deployments

Output Plugins

Various output plugins are available for writing records to other destinations:

• Examples

  • ​Store Apache Logs into Amazon S3​

  • ​Store Apache Logs into MongoDB​

  • ​Data Collection into HDFS​

• List of Plugin References

  • ​Output to Another Fluentd​

  • ​Output to MongoDB or MongoDB ReplicaSet​

  • ​Output to Hadoop​

  • ​Output to File​

  • ​etc...​

High-Availability Configurations of Fluentd

For high-traffic websites (more than 5 application nodes), we recommend using high-availability configuration for td-agent. This will improve the reliability of data transfer and query performance.

• ​High-Availability Configurations of Fluentd​

Monitoring

Monitoring Fluentd itself is also important. The article below describes general monitoring methods for td-agent.

• ​Monitoring Fluentd​

If this article is incorrect or outdated, or omits critical information, please let us know. Fluentd is an open-source project under Cloud Native Computing Foundation (CNCF). All components are available under the Apache 2 License.