out_s3
Output plugin writes records into the Amazon S3 cloud object storage service. By default, it creates files on an hourly basis. This means that when you first import records using the plugin, no file is created immediately.timekey
condition has been met. To change the output frequency, please modify the timekey
value in the buffer section. For more details, see time chunk keys.out_s3
is included in td-agent by default. Fluentd gem users will need to install the fluent-plugin-s3 gem. In order to install it, please refer to the Plugin Management article.<buffer>
section, see Buffer Section Configuration. By default, this plugin uses the file
buffer.@type
(required)s3
.aws_key_id
aws_sec_key
s3_bucket
buffer
s3_region
ENV["AWS_REGION"]
or us-east-1
us-east-1
us-west-1
eu-central-1
ap-southeast-1
sa-east-1
<format>
Directiveout_file
.path
{path}{time_slice_format}_{sequential_index}.gz
(see s3_object_key_format
) by default.s3_object_key_format
%{path}%{time_slice}_%{index}.%{file_extension}
path
: the value of the path
parameter abovetime_slice
: the time string as formatted by buffer configurationindex
: the index for the given path. Incremented per buffer flushfile_extension
: as determined by the store_as
parameter.s3_object_key_format
: defaultpath
: hello
time_slice
: %Y%m%d
store_as
: json
hello20141111_0.json
would be the example of an actual S3 path.%{index}
appears in the customized s3_object_key_format
(Otherwise, multiple buffer flushes within the same time slice throws an error).store_as
lzo
, json
, txt
proxy_uri
ssl_verify_peer
false
, the endpoint SSL certificate is ignored.@log_level
fatal
, error
, warn
, info
, debug
, trace