Exporting Data to an Elasticsearch Instance

Use IoTIFY Database Tool to quickly populate your Elasticsearch instances.

Introduction

Elasticsearch has proven to be very popular when it comes to indexing a large amount of data.  It provides a distributed, multitenant-capable full-text search engine with an HTTP web interface and schema-free JSON documents. 

If you are not familiar with Elasticsearch, check out this awesome guide from elastic.co.
If you are using Elasticsearch in production, chances are that you have encountered a need to populate your index quickly with some specific values. The Logstash, the most common tool for populating Elasticsearch indexes works very well when it comes to analyzing raw logs from multiple formats, however, in certain cases, logs aren’t available. In this article, we show you how to use IoTIFY DB Tool to quickly populate Elasticsearch indexes.

Set up an Elasticsearch Instance: I assume you are already familiar with how to set up an instance. We would recommend opening a managed Elastic account at elastic.co, it works out of the box.

Create a User: Create a user in Kibana dashboard who has the rights to create index and store data. 

Once this is ready, create a template of data which you would like to store. Then go to Database - Generate section and populate the fields as required. Keep in mind that the filename field will be used as the index where data shall be stored in Elasticsearch. 

Simply select option Store In Elasticsearch when specifying where to store your data.

Elasticsearch URL needs to be specified as follows:

https://username:[email protected]:port/

E.g. if you are using a hosted Elasticsearch instance at elastic.co here is how it may look like:

https://username:[email protected]:9243/

Keep in mind that the default behavior is to create the index if it doesn’t exists. If the index already exists, the data shall be appended to it. 

Simply click Generate. That’s it folks.