path, etc.) and buffers them.
td-agentpackage, please install it manually:
/etc/td-agent/td-agent.conf. Otherwise, it is located at
/var/log/apache2/access_log). The Fluentd configuration file should look like this:
@type tail: The tail Input plugin continuously tracks the log
<parse>: Uses Fluentd's built-in Apache log parser.
path /var/log/apache2/access_log: The location of the Apache log.
kinesis.apache.accessis used as the
<match>...</match>is used (i.e. the log is routed according to the config inside). In this example, the
kinesis.apache.accesstag (generated by
tail) is always used.
match.**matches zero or more period-delimited tag parts (e.g.
flush_intervalparameter specifies how often the data is written to Kinesis.
random_partition_key trueoption will generate the partition key via UUID v3 (source). Kinesis Stream consists of
shards, and the processing power of each shard is limited. This partition key will be used by Kinesis to determine which shard has been designated for a specific record.
td-agentto make sure that the configuration change is available:
ab(Apache Bench) program: