how to rename the source columns to target column names while reading the data from BIG QUERY into PCollection in apache beam using python SDK
Question
how to rename the source columns to target column names while reading the data from BIG QUERY into PCollection in apache beam using python SDK
1 answers
solution1
0 2021-02-05 20:52:25
This is possible through Beam DataFrames API , more specifically DataframeTransform . There are still Differences from standard Pandas , make sure to be aware of them.
Let me know if you still need help with a specific example.
The technical post webpages of this site follow the CC BY-SA 4.0 protocol. If you need to reprint, please indicate the site URL or the original address.Any question please contact:yoyou2525@163.com.
Related Question
Creating custom source for reading from cloud datastore using latest python apache_beam cloud datafow sdk
How to create groups of N elements from a PCollection Apache Beam Python
Apache Beam in python: How to reuse exactly the same transform on another PCollection
How to transform bounded pcollection to unbounded in Python with Apache Beam?
Apache Beam - Python : How to get the top 10 elements of a PCollection with Accumulation?
How to get one element from a Pcollection in Apache Beam
How to calculate the number of elements of a PCollection in Apache beam
Apache beam list to PCollection
Improving reading BQ data from inside of a transformation in apache beam - Python
Reading data from MySQL and writing in GCP Bucket using Apache Beam Python API
Related Tags