使用 ExecuteStreamCommand NIFI 通过 windows 批处理文件运行 python 脚本

Question

I understand that this question may have been repeated many times before - I am new to Nifi and unfortunately none of the previous answers worked for me.

I am trying to run a simple python script using the ExecuteStreamCommand processor (in Windows 10). However, I cannot call the python script directly from Nifi as it requires the conda environment to be activated (it gives me an import error for python packages- the same happens when the script is called from both nifi and command prompt).

I have since written a basic batch script to activate the conda environment and run the python script (see below).

activate.bat

CALL conda activate base   
python sample.py
CALL conda deactivate

This works well and produces the output I need when run from the command line. However, calling the bat file from Nifi does not seem to do anything. It does not generate an error (simply pass the incoming flowfile to output with the working directory added to each line of the incoming csv file).

The config in Nifi:

• Command Arguments: C:\Temp\activate.bat

  Command Path: C:\Windows\System32\cmd.exe

Any help would be greatly appreciated.

Answer 1

This worked for me!

cmd "/c activate [my_env] && python my_script.py && deactivate"

Source: Conda environments and.BAT files

Still not sure what the underlying issue was....