简体   繁体   English

提示在Cassandra中超时

[英]Hints are timing out in cassandra

We are seeing lot of hints timing out and I don't see any thing is logs about nodes are going DOWN. 我们看到许多提示超时,我看不到任何有关节点的日志正在关闭的信息。 This is strange to me why cassandra is building up the hints table if it does not think it is down. 对于我来说,这很奇怪,为什么cassandra会在提示表没有出现故障的情况下建立提示表。 I don't see any GC pauses as well. 我也看不到任何GC暂停。

Can someone help me how to solve this problem 有人可以帮我解决这个问题吗

INFO [HintedHandoff:2] 2015-03-11 01:56:00,958 HintedHandOffManager.java (line 469) Timed out replaying hints to /1.1.1.79; aborting (0 delivered)
INFO [HintedHandoff:1] 2015-03-11 02:03:54,914 HintedHandOffManager.java (line 469) Timed out replaying hints to /1.1.1.76; aborting (0 delivered)

The fact that you have hints on that node indicates that the node itself is up. 您在该节点上有提示的事实表明该节点本身已启动。 What this log say is that nodes 1.1.1.79 & 1.1.1.76 are down, or more likely, flapping. 该日志表示节点1.1.1.79和1.1.1.76发生故障,或者更有可能发生故障。 You should check for their statuses. 您应该检查其状态。 Run nodetool tpstats on these nodes, if they are up, look for any dropped mutations. 在这些节点上运行nodetool tpstats(如果它们已启动),查找是否有掉落的突变。 Inspect the logs. 检查日志。

If you want to somehow replicate that behaviour just unplug for 5 seconds, each 10 seconds, 10 times in a row the internet cable from a machine. 如果您想以某种方式复制该行为,只需拔下5秒钟(每10秒钟一次),然后连续十次从计算机上拔出Internet电缆即可。

Here i have some extras from another machine`s /var/log/cassandra/system.log 在这里,我从另一台机器的/var/log/cassandra/system.log中获得了一些额外功能

INFO [HintedHandoff:2] 2016-10-27 14:20:00,333 HintedHandOffManager.java:486 - Timed out replaying hints to /192.168.0.178; aborting (0 delivered) INFO [HintedHandoff:1] 2016-10-27 14:26:13,393 HintedHandOffManager.java:367 - Started hinted handoff for host: fa16996c-722c-458b-a621-eb53efa79fb2 with IP: /192.168.0.178 INFO [HintedHandoff:1] 2016-10-27 14:28:27,959 HintedHandOffManager.java:486 - Timed out replaying hints to /192.168.0.178; aborting (28850 delivered) INFO [HintedHandoff:2] 2016-10-27 14:36:17,398 HintedHandOffManager.java:367 - Started hinted handoff for host: fa16996c-722c-458b-a621-eb53efa79fb2 with IP: /192.168.0.178

I understand that sometimes it timeouts before the actual stream starts 我了解有时有时会在实际流开始之前超时

aborting (0 delivered)

Sometimes it aborts after the stream started, specifying how many were sent and set something like a marker to know from where to stream next time : 有时,它在流开始后中止,指定发送了多少,并设置了类似标记的内容,以便下次知道从何处流:

aborting (28850 delivered)

声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.

 
粤ICP备18138465号  © 2020-2024 STACKOOM.COM