Send AWS EC2 metrics to AWS Elasticsearch Service Domain for monitoring in Kibana

Question

I am stuck on one point I have created one EC2 Linux based instance in Aws. Now I want to send the EC2 metrics data to the managed Elasticsearch domain for monitoring purposes in Kiban, I go through the cloud watch console and check the metric is present of instance but didn't get how to connect with the Elasticsearch domain that I have created.

Can anyone please help me with this situation?

Answer 1

There is no build in mechanism for extraction/streaming of metrics data points in real time. You have to develop a custom solution for that. For example, by having a lambda function which is invoked every minute and which reads data points using get_metric_data . The the lambda would inject the points into your ES.

To invoke a lambda function periodically, eg every 1 minute you would have to setup CloudWatch Event rule with schedule Expressions . Lambda function would also need to have permissions granted to interact with CloudWatch metrics.

Answer 2

Welcome to SO:)

An alternative to the solution suggested by Marcin is to install metricbeat on the EC2 Instance and configure the metricbeat config file to send metrics to your Managed AWS ES Domain.

This is pretty simple and you should be able to do this fairly quickly.