API获取AWS EMR中任务实例组实例的数量

Question

I want to get the count of task instance groups instances in AWS EMR.

For this, I used Cloudwatch to check heartbeat of each task instance groups instances. But I think, at the end EMR is a framework that uses hadoop, and hadoop's master must have information of live task nodes.

Can anyone please tell me the metadata link(or any file location) to get this information ?

Answer 1

I have written a Java tool to dynamically resize an EMR cluster during the processing. It has some code to get the count of instances in an instance, as part of it. Maybe this will be what you are looking for. Check it out at:

http://www.lopakalogic.com/articles/hadoop-articles/dynamically-resize-emr/

The source code is available on Github