pySpark 项目的 Azure DevOps CI 管道

Question

I am trying to implement azure devops on few of my pyspark projects.

some of the projects are developed in pyCharm and some are in intelliJ with python API.

Below is the code structure commited in the git repository.

setup.py is the build file used to create.egg file.

I have tried few of the steps as shown below to create a build pipeline in the devops. But the python installation part/execution part is failing with below error.

##[error]The process 'C:\hostedtoolcache\windows\Python\3.7.9\x64\python.exe' failed with exit code 1

I would prefer UI API for building and creating.egg files, If not possible YAML files.

Any leads appreciated!

Answer 1

I used Use Python step and then all works like a charm

Can you show details of Install Python step?

Answer 2

I have used the following steps and it succeeds!