堆栈内存溢出
  简体   繁体   English

如何在使用 python SDK 将 BIG QUERY 中的数据读取到 apache 光束中的 PCollection 时将源列重命名为目标列名

[英]how to rename the source columns to target column names while reading the data from BIG QUERY into PCollection in apache beam using python SDK

 原文  2021-02-05 07:34:43  2   1    python/ google-cloud-platform/ google-cloud-dataflow/ apache-beam

问题描述

how to rename the source columns to target column names while reading the data from BIG QUERY into PCollection in apache beam using python SDK如何在使用 python SDK 将 BIG QUERY 中的数据读取到 apache 光束中的 PCollection 时将源列重命名为目标列名

1 个解决方案

解决方案1
 0  2021-02-05 20:52:25

This is possible through Beam DataFrames API , more specifically DataframeTransform .这可以通过 Beam DataFrames API ，更具体地说是DataframeTransform 来实现。 There are still Differences from standard Pandas , make sure to be aware of them. 与标准 Pandas 仍然存在差异，请务必注意它们。

Let me know if you still need help with a specific example.如果您仍然需要特定示例的帮助，请告诉我。

暂无
暂无

声明:本站的技术帖子网页，遵循CC BY-SA 4.0协议，如果您需要转载，请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.

相关问题 创建自定义源以使用最新的python apache_beam cloud datafow sdk从云数据存储读取 - Creating custom source for reading from cloud datastore using latest python apache_beam cloud datafow sdk 如何从PCollection Apache Beam Python创建N个元素组 - How to create groups of N elements from a PCollection Apache Beam Python python中的Apache Beam：如何在另一个PCollection上重用完全相同的转换 - Apache Beam in python: How to reuse exactly the same transform on another PCollection 如何使用Apache Beam在Python中将有界pcollection转换为无界？ - How to transform bounded pcollection to unbounded in Python with Apache Beam? Apache Beam-Python：如何通过累积获取PCollection的前10个元素？ - Apache Beam - Python : How to get the top 10 elements of a PCollection with Accumulation? 如何从 Apache Beam 的 Pcollection 中获取一个元素 - How to get one element from a Pcollection in Apache Beam 如何计算Apache Beam中PCollection的元素数量 - How to calculate the number of elements of a PCollection in Apache beam Apache 光束列表到 PCollection - Apache beam list to PCollection 改进从 apache 光束中的转换内部读取 BQ 数据 - Python - Improving reading BQ data from inside of a transformation in apache beam - Python 从 MySQL 读取数据并使用 Apache Beam Python ZDB974238714CA8DE634A7ACE1D8714CA8DE634A7ACE 写入 GCP Bucket - Reading data from MySQL and writing in GCP Bucket using Apache Beam Python API
相关标签
 
粤ICP备18138465号  © 2020-2024 STACKOOM.COM