简体   繁体   English

Cloud Dataflow中的“侧面输入”是否支持从BigQuery视图读取?

[英]Do 'side inputs' in Cloud Dataflow support reading from BigQuery views?

Tried to point a side-input to a BigQuery view, instead of directly to a BigQuery table. 试图将侧输入指向BigQuery视图,而不是直接指向BigQuery表。 It does not produce an error, but simply returns 0 rows. 它不会产生错误,但只返回0行。 View works fine inside BigQuery. View在BigQuery中运行良好。

For example, given a view referencing a table 'types_test' with just 1 row: 例如,给定一个只引用一行的表'types_test'的视图:

在此输入图像描述

In BigQuery, it works fine: 在BigQuery中,它工作正常:

在此输入图像描述

But using the view as a side-input in Dataflow return 0 rows: 但是使用视图作为Dataflow中的side-input返回0行:

INFO: Reading from BigQuery table <removed>:CPT_7414_PLAYGROUND.view_test
Mar 20, 2015 11:10:08 PM com.google.cloud.dataflow.sdk.io.BigQueryIO evaluateReadHelper
INFO: Number of records read from BigQuery: 0

Do side-inputs support views in BigQuery, or do you need to do something else to use a view for a side-input? 在BigQuery中进行侧输入支持视图,还是需要做其他事情来使用视图进行侧输入?

Found in the FAQ's, that views are not currently supported. 在FAQ中找到,目前不支持这些视图。

http://goo.gl/ZVNTnp http://goo.gl/ZVNTnp

声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.

相关问题 Cloud Dataflow 作业从一个 BigQuery 项目读取并写入另一个 BigQuery 项目 - Cloud Dataflow job reading from one Bigquery project and writing to another BigQuery project 在数据流中从BigQuery读取时设置maximumBillingTier - Set maximumBillingTier when reading from BigQuery in Dataflow 在一个Dataflow作业中与BigQuery进行读写 - Writing and reading to and from BigQuery in one Dataflow job 使用 Apache Beam/Dataflow 从 BigQuery 读取时使用 fastavro - Use fastavro when reading from BigQuery using Apache Beam/Dataflow 云数据流,PubSub和Bigquery问题 - Cloud Dataflow, PubSub & Bigquery Issues 云数据流:在BigQuery中生成表 - Cloud Dataflow: Generating tables in BigQuery 使用 ValueProvider 从 Dataflow 模板读取 BigQuery 时出现异常 - Exception when reading BigQuery from Dataflow template using ValueProvider 从 URL 到 BigQuery 的 GCP 云函数与 ETL 数据流 - GCP Cloud Functions vs Dataflow for ETL from URL to BigQuery 从Google Cloud BigQuery读取数据 - Reading data from Google Cloud BigQuery BigQuery UI 中的 Cloud DataFlow SQL 无法读取 Cloud Storage 文件集:“找不到表:datacatalog.entry” - Cloud DataFlow SQL from BigQuery UI cannot read Cloud Storage filesets: "Table not found: datacatalog.entry"
 
粤ICP备18138465号  © 2020-2024 STACKOOM.COM