简体   繁体   中英

Apache Beam - BigQueryIO read Projection

I have a Dataflow pipeline that reads from a BigQuery table. However, when reading the data, there is no other option than to read all records with the read(SerializableFunction) or the readTableRows() methods. I was wondering, when using these methods, is there an option to provide a column-like projection (similar to the HBaseIO Scan addColumn() filter).

I know that there is the option of performing a query when loading data from BigQuery (using the readTableRows().fromQuery() ), but I'm wondering if there is a similar option to do projection like possible in HBaseIO.

到目前为止,fromQuery()是唯一的选择,但是将来可能会改变。

The technical post webpages of this site follow the CC BY-SA 4.0 protocol. If you need to reprint, please indicate the site URL or the original address.Any question please contact:yoyou2525@163.com.

 
粤ICP备18138465号  © 2020-2024 STACKOOM.COM