简体   繁体   English

在 python 中使用谷歌数据流进行 Bigquery 到 Bigtable 的数据传输

[英]Bigquery to Bigtable data transfer using google dataflow in python

We are using the dataflow pipeline written in JAVA for transfering data from bigquery to bigtable.我们正在使用用 JAVA 编写的数据流管道将数据从 bigquery 传输到 bigtable。 eg https://github.com/GoogleCloudPlatform/cloud-bigtable-examples/blob/master/java/dataflow-connector-examples/src/main/java/com/google/cloud/bigtable/dataflow/example/BigQueryBigtableTransfer.java例如https://github.com/GoogleCloudPlatform/cloud-bigtable-examples/blob/master/java/dataflow-connector-examples/src/main/java/com/google/cloud/bigtable/dataflow/example/BigQueryBigtableTransfer.java

I am trying to write same code in python.我正在尝试在 python 中编写相同的代码。 But I am not able to get the bigtable dataflow connector for python.但是我无法获得 python 的 bigtable 数据流连接器。 Any clue how it can be done?任何线索如何做到?

Just not to leave the question unanswered, as Graham Polley commented: "The Python SDK doesn't have support for Bigtable yet."只是不要让问题悬而未决,正如 Graham Polley 评论的那样: “Python SDK 尚不支持 Bigtable。” . . I see that engineer from Bigtable is already involved, but if you want, you can also create a feature request in Public Issue Tracker .我看到 Bigtable 的工程师已经参与其中,但如果您愿意,您也可以在Public Issue Tracker 中创建功能请求。

声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.

相关问题 Google Dataflow python中的API版本BigQuery - API version BigQuery in Google Dataflow python 使用 Google Cloud Functions 在两个 BigQuery 项目之间传输数据 - Data Transfer between two BigQuery Projects using Google Cloud Functions 使用python在没有数据流的情况下发布到bigquery - pubsub to bigquery without dataflow using python 如何使用 Python 创建 BigQuery 数据传输服务 - How to create BigQuery Data Transfer Service using Python 使用数据流将数据从 MySQL 加载到 BigQuery - Load data from MySQL to BigQuery using Dataflow 获取禁止:403 访问被拒绝,当请求使用 python 将数据从谷歌云存储传输到 bigquery 时 - get Forbidden: 403 Access Denied when do request to transfer data from google cloud storage to bigquery using python 使用 Dataflow 和 Apache Beam (Python) 将 Pub/Sub 中的流数据发布到 BigQuery - Issues streaming data from Pub/Sub into BigQuery using Dataflow and Apache Beam (Python) Google数据流:无法在不同位置读取和写入BigQuery-Python - Google Dataflow: Cannot read and write in different locations BigQuery - Python Google Dataflow:在Python中使用BigQuery + Pub / Sub运行动态查询 - Google Dataflow: running dynamic query with BigQuery+Pub/Sub in Python BigQuery数据传输服务-python客户端库 - BigQuery Data Transfer Services - python client library
 
粤ICP备18138465号  © 2020-2024 STACKOOM.COM