无法运行程序“ pip --version”（在目录“。”中）：error = 2，没有这样的文件或目录

Question

I execute a simple Linux command through aws emr . This command is launched on the nodes of a cluster:

aws emr add-steps --cluster-id j-XXXXXXXXXX --steps Name="XXX",Jar="command-runner.jar",Args=["pip --version"]

or:

aws emr add-steps --cluster-id j-XXXXXXXXXX --steps Name="XXX",Jar="command-runner.jar",Args=["python --version"]

These basic commands give an error:

Cannot run program "pip --version" (in directory "."): error=2, No such file or directory

Cannot run program "python --version" (in directory "."): error=2, No such file or directory

I am sure that at least python is installed on the nodes, because I can execute spark-submit with *.py files.

The only command that I was able to execute was ls .

PS The objective of using this approach is to be able to execute some Linux scripts on different nodes of the cluster, eg pip install ... . That's why I started with making small experiments and was unable to make them working.

Answer 1

The problem was due to the lack of comma , between the arguments. There should be pip,--version instead of pip --version :

aws emr add-steps --cluster-id j-XXXXXXXXXX --steps Name="XXX",Jar="command-runner.jar",Args=["pip,--version"]