google cloud dataflow mysql io connector using python
Question
what is the efficient way to insert streaming records into MySQL from google-dataflow using python.Is there any IO connector as in case of bigquery?I see that or bigquery has beam.io.WriteToBigQuery. how can we use similar io connector in cloud-MySQL
1 answers
solution1
1 ACCPTED 2020-03-08 14:01:15
You can you JDBCIO to read and write data from/to a JDBC database compliant database.
You can find the details here testWrite
The technical post webpages of this site follow the CC BY-SA 4.0 protocol. If you need to reprint, please indicate the site URL or the original address.Any question please contact:yoyou2525@163.com.
Related Question
Google Cloud Dataflow with Python
Using CombinePerKey in Google Cloud Dataflow Python
Google Cloud Dataflow Python --maxNumWorkers
Read Shapefile from Google Cloud Storage using Dataflow + Beam + Python
Read a set of xml files using Google Cloud DataFlow python sdk
Using the google.cloud.sql.connector Python library in Python
Is possible to execute Stored Procedure MySQL Azure using apache beam in cloud dataflow google cloud platform?
Schedule a Google Cloud Dataflow job in Python
Google Cloud Dataflow Python, Retrieving Job ID
Passing AWS credentials to Google Cloud Dataflow, Python
Related Tags