运行 Kedro 管道时出现 Protobuf 兼容性错误

Question

I have a Kedro pipeline that I want to run through a Python script, I think I have the minimum necessary code to do this, but everytime I try to run the pipeline through the script, I get a compatibility error regarding the protobuf version, but when I run the pipeline through the terminal it runs without problems. It is important to say that I am running everything inside a Docker container, and the image is based on PyTorch (version 1.9.0 and cuda 11.1).

This is the code I am using to call the pipeline:

from kedro.framework.context import load_context

class TBE():
  def run_inference():
    context = load_context('./')
    output = context.run(pipeline='inf')
    return output

And here is the error that I get when I run it:

[libprotobuf FATAL google/protobuf/stubs/common.cc:83] This program was compiled against 
version 3.9.2 of the Protocol Buffer runtime library, which is not compatible with the 
installed version (3.19.4).  Contact the program author for an update.  If you compiled 
the program yourself, make sure that your headers are from the same version of Protocol 
Buffers as your link-time library.  (Version verification failed in "bazel-out/k8- 
opt/bin/tensorflow/core/framework/tensor_shape.pb.cc".)
terminate called after throwing an instance of 'google::protobuf::FatalException'
what():  This program was compiled against version 3.9.2 of the Protocol Buffer runtime 
library, which is not compatible with the installed version (3.19.4).  Contact the 
program author for an update.  If you compiled the program yourself, make sure that your 
headers are from the same version of Protocol Buffers as your link-time library.  
(Version verification failed in "bazel-out/k8- 
opt/bin/tensorflow/core/framework/tensor_shape.pb.cc".)
Aborted

I have already tried changing the protobuf version, but I cannot find a compatible one. What can I do to solve this problem?

Answer 1

I faced a similar problem with kedro. This helped:

pip install --upgrade "protobuf<=3.20.1"

Answer 2

您好，我不完全确定这是否会解决问题 - 但是这里记录了像这样启动 Kedro 运行的正确方法，也许可以解释这种方式与在终端中运行kedro run之间的差异： https:// kedro.readthedocs.io/en/stable/04_kedro_project_setup/03_session.html