[英]Does setup.py actually load the packages to GCP Dataflow?
Here I am using setup.py to install dependencies for my dataflow job, but in the GCP Dataflow Stackdriver error logs I am getting an error on downloading a package. 在这里,我使用setup.py为我的数据流作业安装依赖项,但是在GCP数据流Stackdriver错误日志中,下载软件包时出现错误。
Does this below code when I run locally does dataflow have access to them irrelevant of which artifactory or pip server dataflow is linked to? 当我在本地运行时,下面的代码是否与链接到哪个工件或pip服务器数据流无关地访问数据流?
from __future__ import absolute_import
from setuptools import setup, find_packages
setup(name='DataflowpipelineDependencies',
version='0.1',
description='Dependencies',
install_requires=[
'google-cloud-storage==1.16.1',
'jsonschema==2.6.0',
'vm-cloudevents==0.1.0' // Private artifactory package
],
packages = find_packages()
)
您可以使用--setup_file
选项上传依赖项。
声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.