How to query data from BigQuery using JAVA API

Question

We have a api project written in JAVA using spring hibernate and reading data from MySQL. Recently, we added another data source as BigQuery, therefore we want to allow user to call certain apis to query data from BigQuery - order count from orders table in BigQuery using JAVA api client. Looked at the github sample, but not clear about how to setup and access.

Also found this link but not sure about registering a web application, etc. Please advise.

Update: Imagine this as a web application which shows count of orders in the last 5 days if I select a merchant. but the orders table is in BigQuery. My web application calls-> java api layer which calls -> bigquery using client library -> populates the response as a json -> web application receives the count of orders.

I feel the hiccup is in authenticating using GoogleCredential. Generated a new Oauth Client Id which provided a client_id and client_secret. But still it is not able to authenticate to the project and give results.

Thanks.

Answer 1

Since your question is generalized, I believe what you need is to understand Google's BigQuery on how it works, how to setup the data etc.

Once you setup the data in BigQuery, you can access BigQuery by using a web UI or a command-line tool, or by making calls to the BigQuery REST API using a variety of client libraries such as Java, .NET or Python

You also haven't mentioned that whether you have gone through the basics .

I hope this link will be helpful in understanding how to import data to BigQuery and setting up the data, querying etc.

Answer 2

Use Service Accounts to connect to your BQ.

And please be aware that the response time will be 2-3 seconds as this is a big data tool not a real time db for web use. Not sure if that's how you want your web application to work. You may need to cache the number in your local database.