简体   繁体   English

setup.py是否实际将软件包加载到GCP Dataflow?

[英]Does setup.py actually load the packages to GCP Dataflow?

Here I am using setup.py to install dependencies for my dataflow job, but in the GCP Dataflow Stackdriver error logs I am getting an error on downloading a package. 在这里,我使用setup.py为我的数据流作业安装依赖项,但是在GCP数据流Stackdriver错误日志中,下载软件包时出现错误。

Does this below code when I run locally does dataflow have access to them irrelevant of which artifactory or pip server dataflow is linked to? 当我在本地运行时,下面的代码是否与链接到哪个工件或pip服务器数据流无关地访问数据流?

 from __future__ import absolute_import
 from setuptools import setup, find_packages

setup(name='DataflowpipelineDependencies',
  version='0.1',
  description='Dependencies',
  install_requires=[
    'google-cloud-storage==1.16.1',
    'jsonschema==2.6.0',
    'vm-cloudevents==0.1.0' // Private artifactory package
  ],
  packages = find_packages()
 )

您可以使用--setup_file选项上传依赖项。

声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.

 
粤ICP备18138465号  © 2020-2024 STACKOOM.COM