Recipe Http Rest Api To Mongo

Looking to get data out of http rest api into mongo? You can do that with fluentd in 10 minutes!

Here is how:

$ gem install fluentd
$ gem install fluent-plugin-mongo
$ touch fluentd.conf

fluentd.conf should look like this (just copy and paste this into fluentd.conf):

<source>
@type http
port 8888
bind 0.0.0.0
body_size_limit 32m
keepalive_timeout 10s
# tag is part of the URL, e.g.,
# curl -X POST -d 'json={"action":"login","user":2}' http://localhost:8888/tag.here
</source>
‚Äč
<match **>
@type mongo
database <db name> #(required)
collection <collection name> #(optional; default="untagged")
host <hostname> #(optional; default="localhost")
port <port> #(optional; default=27017)
</match>

After that, you can start fluentd and everything should work:

$ fluentd -c fluentd.conf

Of course, this is just a quick example. If you are thinking of running fluentd in production, consider using td-agent, the enterprise version of Fluentd packaged and maintained by Treasure Data, Inc..

If this article is incorrect or outdated, or omits critical information, please let us know. Fluentd is a open source project under Cloud Native Computing Foundation (CNCF). All components are available under the Apache 2 License.