如何从BigQuery检索数据并将数据插入到mySQL？

Question

I'm trying to write a batch file which can retrieve specific data from Google BigQuery and then insert these data to mySQL.

The language for batch server is Java and the build tool is Ant.

Answer 1

As Iñigo mentioned, you can read the data from BigQuery with the BigQuery Java client library . This would be the easiest approach. You have 2 options here:

a.Create a query job to get the result set of a SQL query, parse the result and write it to MySQL. For this approach you can use:

1. The “Job create” method to create a query job (see an example in the link).
2. The “getJob” method to get the status of the asynchronous job.
3. The “getQuery” method results method to get the result set.

b.Create an export job , which will export the data of a BigQuery table to a file in Cloud Storage, then, download the file from Cloud Storage and write the data to MySQL. Note this method will be more difficult if you are not familiar to Google Cloud Platform, since you'll need to create a Cloud Storage bucket and interact with the Cloud Storage Java library .

To write the data to MySQL you'll need to use a Java Connector like this one .

Hope this points you into the right direction.