[英]Google pubsub: pull java sample client hanging
I am using google pubsub to pull messages from a subscribed topic asynchronously. 我正在使用google pubsub异步从订阅的主题中提取消息。
I am using the below sample code: 我正在使用以下示例代码:
public void startStreaming() {
Subscriber subscriber = null;
try {
SubscriptionName subscription = SubscriptionName.of("topic-test",
"subscription-id-1234");
ExecutorProvider executorProvider =
InstantiatingExecutorProvider.newBuilder()
.setExecutorThreadCount(1)
.build();
MessageReceiver receiver =
new MessageReceiver() {
@Override
public void receiveMessage(PubsubMessage message, AckReplyConsumer consumer) {
try {
String msg = message.getData().toStringUtf8();
System.out.println(msg);
} catch (Exception e) {
throw new RuntimeException("Failed to pull messages from topic");
}
consumer.ack();
}
};
subscriber = Subscriber
.newBuilder(subscription, receiver)
.setExecutorProvider(executorProvider)
.build();
subscriber.addListener(
new Subscriber.Listener() {
@Override
public void failed(Subscriber.State from, Throwable failure) {
// Handle failure. This is called when the Subscriber encountered a fatal error and is shutting down.
logger.error("Subscriber is not able to hook on google pubsub topic", failure);
}
},
MoreExecutors.directExecutor());
subscriber.startAsync().awaitRunning();
// why should I put sleep here??
Thread.sleep(60000);
} catch (Exception e) {
} finally {
if (subscriber != null) {
subscriber.stopAsync().awaitTerminated();
}
}
}
It works fine (ingest messages) for few minutes and get stuck with no more ingestion of messages, I am sure that there are messages as once I restarted the pulling client, it reads data normally. 它可以在几分钟内正常工作(摄取消息),并且不再卡住任何消息,我确信一旦重新启动拉取客户端,它就会正常读取数据。
Nov 12, 2017 7:33:17 PM com.google.cloud.pubsub.v1.StreamingSubscriberConnection sendAckOperations
WARNING: failed to send acks
java.lang.IllegalStateException: call was cancelled
at com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at io.grpc.internal.ClientCallImpl.sendMessage(ClientCallImpl.java:405)
at io.grpc.ForwardingClientCall.sendMessage(ForwardingClientCall.java:52)
at io.grpc.ForwardingClientCall.sendMessage(ForwardingClientCall.java:52)
at io.grpc.stub.ClientCalls$CallToStreamObserverAdapter.onNext(ClientCalls.java:286)
at com.google.cloud.pubsub.v1.StreamingSubscriberConnection.sendAckOperations(StreamingSubscriberConnection.java:274)
at com.google.cloud.pubsub.v1.MessageDispatcher.processOutstandingAckOperations(MessageDispatcher.java:602)
at com.google.cloud.pubsub.v1.MessageDispatcher.access$2100(MessageDispatcher.java:56)
at com.google.cloud.pubsub.v1.MessageDispatcher$AckDeadlineAlarm.run(MessageDispatcher.java:529)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
And when don't use ExecutorProvider executorProvider I got the below log 当不使用ExecutorProvider executorProvider时,我得到以下日志
2017-11-12 19:08:43 [grpc-default-worker-ELG-2-3] DEBUG io.grpc.netty.NettyClientHandler [id: 0xdc0e7c4d, L:/10.8.17.4:47347 - R:pubsub.googleapis.com/1.1.1.1:111] OUTBOUND WINDOW_UPDATE: streamId=3 windowSizeIncrement=1048576
2017-11-12 19:08:43 [grpc-default-worker-ELG-2-4] DEBUG io.grpc.netty.NettyClientHandler [id: 0x330498ce, L:/10.8.17.4:47346 - R:pubsub.googleapis.com/1.1.1.1:111] OUTBOUND GO_AWAY: lastStreamId=0 errorCode=0 length=0 bytes=
2017-11-12 19:08:43 [grpc-default-worker-ELG-2-3] DEBUG io.grpc.netty.NettyClientHandler [id: 0xdc0e7c4d, L:/10.8.17.4:47347 - R:pubsub.googleapis.com/1.1.1.1:111] OUTBOUND GO_AWAY: lastStreamId=0 errorCode=0 length=0 bytes=
2017-11-12 19:08:44 [threadDeathWatcher-1-1] DEBUG io.netty.buffer.PoolThreadCache Freed 3 thread-local buffer(s) from thread: threadDeathWatcher-1-1
2017-11-12 19:08:44 [threadDeathWatcher-1-1] DEBUG io.netty.buffer.PoolThreadCache Freed 1 thread-local buffer(s) from thread: threadDeathWatcher-1-1
2017-11-12 19:08:44 [grpc-default-worker-ELG-2-3] DEBUG io.netty.buffer.PoolThreadCache Freed 153 thread-local buffer(s) from thread: grpc-default-worker-ELG-2-3
2017-11-12 19:08:44 [grpc-default-worker-ELG-2-4] DEBUG io.netty.buffer.PoolThreadCache Freed 131 thread-local buffer(s) from thread: grpc-default-worker-ELG-2-4
Could you please help? 能否请你帮忙?
It is now working fine, was to remove the below 现在工作正常,已删除以下内容
lines,
// if (subscriber != null) {
// subscriber.stopAsync().awaitTerminated();
// }
The explanation, here is this github thread 1827 说明,这是这个github 线程1827
And it really make sense, what is missing is more documentation in Google-cloud docs give more details about like the comment provided in the github thread. 确实是有道理的,所缺少的是Google-cloud文档中的更多文档提供了有关github线程中提供的注释之类的更多详细信息。
Edit: Github ticket is created to add more documentation, and closed below: 2616 编辑:创建Github票证以添加更多文档,并在下面关闭: 2616
声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.