Perl - Fluentd

Search…
Perl
The Fluent::Logger library is used to post records from Perl applications to Fluentd.
This article explains how to use it.
Prerequisites
Basic knowledge of Perl
Basic knowledge of Fluentd
Perl 5.10 or higher
Installing Fluentd
Please refer to the following documents to install fluentd:
​Install Fluentd with rpm Package​
​Install Fluentd with deb Package​
​Install Fluentd with Ruby Gem​
​Install Fluentd from source​
Modifying the Config File
Configure Fluentd to use the forward input plugin as its data source:
<source>
  @type forward
  port 24224
</source>
<match fluentd.test.**>
  @type stdout
</match>
Restart agent after configuring.
# for rpm/deb only
$ sudo /etc/init.d/td-agent restart
​
# or systemd
$ sudo systemctl restart td-agent.service
Using Fluent::Logger
Install Fluent::Logger library via CPAN:
$ cpan
cpan[1]> install Fluent::Logger
Create a script to post the records:
# test.pl
use Fluent::Logger;
my $logger = Fluent::Logger->new(
    host => '127.0.0.1',
    port => 24224,
    tag_prefix => 'fluentd.test',
);
$logger->post("follow", { "entry1" => "value1", "entry2" => 2 });
Executing the script will send the logs to Fluentd:
$ perl test.pl
The logs should be output to /var/log/td-agent/td-agent.log or the standard output of the Fluentd process via stdout output plugin.
Production Deployments
Output Plugins
Various output plugins are available for writing records to other destinations:
Examples
​Store Apache Logs into Amazon S3​
​Store Apache Logs into MongoDB​
​Data Collection into HDFS​
List of Plugin References
​Output to Another Fluentd​
​Output to MongoDB or MongoDB ReplicaSet​
​Output to Hadoop​
​Output to File​
​etc...​
High-Availability Configurations of Fluentd
For high-traffic websites (more than 5 application nodes), we recommend using the high-availability configuration for td-agent. This will improve the reliability of data transfer and query performance.
​High-Availability Configurations of Fluentd​
Monitoring
Monitoring Fluentd itself is also important. The article below describes the general monitoring methods for td-agent.
​Monitoring Fluentd​
If this article is incorrect or outdated, or omits critical information, please let us know. Fluentd is an open-source project under Cloud Native Computing Foundation (CNCF). All components are available under the Apache 2 License.
Python
PHP
Last modified 1yr ago
Copy link
On this page
Prerequisites
Installing Fluentd
Modifying the Config File
Using Fluent::Logger
Production Deployments
Output Plugins
High-Availability Configurations of Fluentd
Monitoring