Fluentd
Search…
1.0
Scala
This article explains how to use it.
Prerequisites
- Basic knowledge of Scala and sbt
- Basic knowledge of Fluentd
- Scala 2.11.0 or later
- sbt 0.12.0 or later
Installing Fluentd
Please refer to the following documents to install fluentd:
Modifying the Config File
1
<source>
2
@type forward
3
port 24224
4
</source>
5
<match fluentd.test.**>
6
@type stdout
7
</match>
Copied!
Restart agent after configuring.
1
# for rpm/deb only
2
$ sudo /etc/init.d/td-agent restart
3
​
4
# or systemd
5
$ sudo systemctl restart td-agent.service
Copied!
Using fluent-logger-scala
fluent-logger-scalaAdd the following lines to
build.sbt:1
resolvers += "Apache Maven Central Repository" at "http://repo.maven.apache.org/maven2/"
2
​
3
libraryDependencies += "org.fluentd" %% "fluent-logger-scala" % "(version)"
Copied!
or
1
resolvers += "Sonatype Repository" at "http://oss.sonatype.org/content/repositories/releases"
2
​
3
libraryDependencies += "org.fluentd" %% "fluent-logger-scala" % "(version)"
Copied!
Create an app with the following code:
1
import org.fluentd.logger.scala.FluentLoggerFactory
2
import scala.collection.mutable.HashMap
3
​
4
object Sample {
5
val LOG = FluentLoggerFactory.getLogger("fluentd.test")
6
​
7
def main(args: Array[String]): Unit = {
8
​
9
...
10
val data = new HashMap[String, String]();
11
data.put("from", "userA");
12
data.put("to", "userB");
13
LOG.log("follow", data);
14
...
15
}
16
}
Copied!
Executing the script will send the logs to Fluentd:
1
$ sbt
2
> run
Copied!
The logs should be output to
/var/log/td-agent/td-agent.log or the standard output of the Fluentd process via the stdout output plugin.Production Deployments
Output Plugins
- Examples
- List of Plugin References
High-Availability Configurations of Fluentd
For high-traffic websites (more than 5 application nodes), we recommend using the high-availability configuration for
td-agent. This will improve the reliability of data transfer and query performance.Monitoring
Monitoring Fluentd itself is also important. The article below describes the general monitoring methods for
td-agent.If this article is incorrect or outdated, or omits critical information, please let us know. Fluentd is an open-source project under Cloud Native Computing Foundation (CNCF). All components are available under the Apache 2 License.
Last modified 1yr ago