Send Apache Logs to Minio
Last updated
Was this helpful?
Last updated
Was this helpful?
This article explains how to use Fluentd to aggregate and transport Apache logs to a server.
The following software/services are required to be set up correctly:
(S3 Compatible Storage)
(with the Combined Log Format)
You can install Fluentd via major packaging systems.
If (fluent-plugin-s3) is not installed yet, please install it manually.
See section how to install fluent-plugin-s3 on your environment.
In this example, we use the access log file as an input source, so save the following <source>
settings to /etc/fluent/fluentd.conf
:
Before proceeding, please confirm that the access log file has proper file permission. If the log file is not readable by the fluent-package
/fluentd
, the rest of this article will not work.
After adding the settings to the conf file, please restart the Fluentd daemon.
Use curl
to generate some log data for testing:
Or you can use the Apache Bench for the bulk request generation:
Wait until the data gets flushed from the buffer (you can adjust the flush interval using the timekey
and timekey_wait
options above). Then you will see the aggregated log data on Minio:
Now let's add settings for storing the incoming data in your Minio server. Since Minio is compatible with Amazon Simple Storage Service (S3), we can use the plugin to connect to the server.
If this article is incorrect or outdated, or omits critical information, please . is an open-source project under . All components are available under the Apache 2 License.