Spark Cluster on EC2 - “ssh-ready” state pops up for password

Question

I am trying to create a Spark cluster on EC2 with the following command (I am referring Apache documetnation )

./spark-ec2 --key-pair=spark-cluster --identity-file=/Users/abc/spark-cluster.pem --slaves=3 --region=us-west-1 --zone=us-west-1c --vpc-id=vpc-2e44594 --subnet-id=subnet-18447841 --spark-version=1.6.1 launch spark-cluster 

Once I fire above command master and slaves are getting created but once process reaches to 'SSH-ready' state process keeps on waiting for password

below is the Trace. I have referred apache official documentation and many other documents/videos none of the creations asked for the password. not sure whether I am missing something, any pointer to this issue is much appreciated.

Creating security group spark-cluster-master Creating security group spark-cluster-slaves Searching for existing cluster spark-cluster in region us-west-1... Spark AMI: ami-1a250d3e Launching instances... Launched 3 slaves in us-west-1c, regid = r-32249df4 Launched master in us-west-1c, regid = r-5r426bar Waiting for AWS to propagate instance metadata... **

Waiting for cluster to enter 'ssh-ready' state..........Password:

**

Answer 1

修改了spark-ec2.py脚本以包括代理，并使AWS Nat允许出站呼叫