![](/img/trans.png)
[英]Issue with TensorFlow tensorflow_transform.beam on Windows
[英]ImportError: No module named tensorflow_transform.beam
向 GCP 提交 Dataflow 作業時,出現此錯誤:
Traceback (most recent call last):
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/batchworker.py", line 766, in run
self._load_main_session(self.local_staging_directory)
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/batchworker.py", line 482, in _load_main_session
pickler.load_session(session_file)
File "/usr/local/lib/python2.7/dist-packages/apache_beam/internal/pickler.py", line 266, in load_session
return dill.load_session(file_path)
File "/usr/local/lib/python2.7/dist-packages/dill/_dill.py", line 402, in load_session
module = unpickler.load()
File "/usr/lib/python2.7/pickle.py", line 864, in load
dispatch[key](self)
File "/usr/lib/python2.7/pickle.py", line 1139, in load_reduce
value = func(*args)
File "/usr/local/lib/python2.7/dist-packages/dill/_dill.py", line 818, in _import_module
return __import__(import_name)
ImportError: No module named tensorflow_transform
我的假設是預先安裝了 tensorflow-transform 和 apache-beam 等要求,並且它在幾個月前就可以使用了。
這是解決方案,將其放在此處供面臨相同問題的人使用。
假設文件包含所有梁步驟,您需要在與您正在運行的文件相同的目錄中包含 setup.py 文件。
import setuptools
setuptools.setup(
name='whatever-name',
version='0.0.1',
install_requires=[
'apache-beam==2.10.0',
'tensorflow-transform==0.12.0'
],
packages=setuptools.find_packages(),
)
在我有的python文件中
options = PipelineOptions()
必須改為:
options = PipelineOptions(setup_file="./setup.py")
聲明:本站的技術帖子網頁,遵循CC BY-SA 4.0協議,如果您需要轉載,請注明本站網址或者原文地址。任何問題請咨詢:yoyou2525@163.com.