java bigquery storage write api

Question

Using the java bigquery storage api as documented here https:\/\/cloud.google.com\/bigquery\/docs\/write-api<\/a> . Keeping the write stream long lived and refreshing it when one of the non-retry-able errors happened as per thishttps:\/\/cloud.google.com\/bigquery\/docs\/write-api#error_handling<\/a>

I have two tables and different parts of code responsible for writing to each table, maintaining its own stream writer.

No errors. However I want to test refreshing the stream writers work too so I wait for default stream timeout (10mins) which closes the stream and try writing again. I can create the stream fine, no error there, but for one of the table I keep getting cancelled error wrapped in a Pre condition failed making my code refresh again and again.

! io.grpc.StatusRuntimeException: FAILED_PRECONDITION: Stream is closed due to com.google.api.gax.rpc.AbortedException: io.grpc.StatusRuntimeException: ABORTED: Closing the stream because it has been inactive for 600 seconds. Entity: projects/<id>/datasets/<id>/tables/<id>/_default
! at com.google.cloud.bigquery.storage.v1beta2.StreamWriterV2.appendInternal(StreamWriterV2.java:263)
! at com.google.cloud.bigquery.storage.v1beta2.StreamWriterV2.append(StreamWriterV2.java:234)
! at com.google.cloud.bigquery.storage.v1beta2.JsonStreamWriter.append(JsonStreamWriter.java:114)
! at com.google.cloud.bigquery.storage.v1beta2.JsonStreamWriter.append(JsonStreamWriter.java:89)

Answer 1

could you try updating to using the v1 version of the client? We have added reconnect support for the JsonStreamwriter which should help with retries.