简体繁体 English

使用python的谷歌云数据流mysql io连接器

[英]google cloud dataflow mysql io connector using python

原文 2020-03-04 18:02:22 7 1 python/ mysql/ google-cloud-dataflow/ google-cloud-sql/ apache-beam-io

what is the efficient way to insert streaming records into MySQL from google-dataflow using python.Is there any IO connector as in case of bigquery?I see that or bigquery has beam.io.WriteToBigQuery.使用 python 从 google-dataflow 将流记录插入 MySQL 的有效方法是什么。有没有像 bigquery 的 IO 连接器？我看到或者 bigquery 有 beam.io.WriteToBigQuery。 how can we use similar io connector in cloud-MySQL我们如何在云 MySQL 中使用类似的 io 连接器

1 个解决方案

You can you JDBCIO to read and write data from/to a JDBC database compliant database.您可以使用JDBCIO从/向 JDBC 数据库兼容数据库读取和写入数据。

You can find the details here testWrite您可以在此处找到详细信息testWrite

带有Python的Google Cloud Dataflow - Google Cloud Dataflow with Python

在Google Cloud Dataflow Python中使用CombinePerKey - Using CombinePerKey in Google Cloud Dataflow Python

Google Cloud Dataflow Python --maxNumWorkers - Google Cloud Dataflow Python --maxNumWorkers

使用 Dataflow + Beam + Python 从 Google Cloud Storage 读取 Shapefile - Read Shapefile from Google Cloud Storage using Dataflow + Beam + Python

使用Google Cloud DataFlow python sdk读取一组xml文件 - Read a set of xml files using Google Cloud DataFlow python sdk

在 Python 中使用 google.cloud.sql.connector Python 库 - Using the google.cloud.sql.connector Python library in Python

是否可以在云数据流谷歌云平台中使用 apache 光束执行存储过程 MySQL Azure？ - Is possible to execute Stored Procedure MySQL Azure using apache beam in cloud dataflow google cloud platform?

使用Python安排Google Cloud Dataflow作业 - Schedule a Google Cloud Dataflow job in Python

"Google Cloud Dataflow Python，检索作业 ID" - Google Cloud Dataflow Python, Retrieving Job ID

将 AWS 凭证传递给 Google Cloud Dataflow，Python - Passing AWS credentials to Google Cloud Dataflow, Python

暂无

暂无

声明:本站的技术帖子网页，遵循CC BY-SA 4.0协议，如果您需要转载，请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.

相关问题 带有Python的Google Cloud Dataflow - Google Cloud Dataflow with Python 在Google Cloud Dataflow Python中使用CombinePerKey - Using CombinePerKey in Google Cloud Dataflow Python Google Cloud Dataflow Python --maxNumWorkers - Google Cloud Dataflow Python --maxNumWorkers 使用 Dataflow + Beam + Python 从 Google Cloud Storage 读取 Shapefile - Read Shapefile from Google Cloud Storage using Dataflow + Beam + Python 使用Google Cloud DataFlow python sdk读取一组xml文件 - Read a set of xml files using Google Cloud DataFlow python sdk 在 Python 中使用 google.cloud.sql.connector Python 库 - Using the google.cloud.sql.connector Python library in Python 是否可以在云数据流谷歌云平台中使用 apache 光束执行存储过程 MySQL Azure？ - Is possible to execute Stored Procedure MySQL Azure using apache beam in cloud dataflow google cloud platform? 使用Python安排Google Cloud Dataflow作业 - Schedule a Google Cloud Dataflow job in Python "Google Cloud Dataflow Python，检索作业 ID" - Google Cloud Dataflow Python, Retrieving Job ID 将 AWS 凭证传递给 Google Cloud Dataflow，Python - Passing AWS credentials to Google Cloud Dataflow, Python

相关标签

粤ICP备18138465号 © 2020-2024 STACKOOM.COM