frequently getting stale alerts for Datanodes

Question

I am getting stale alerts every hr, if the last point of contact between Data nodes and Namenode is more than 30 s we get these alerts.

I am not able to find the root cause of this slowness, I have 32 cores system, but when this alert is generated in htop hdfs usage is more but not all cores are 100% utilized.

DataNode Health Summary

DataNode Health: [Live=5, Stale=1, Dead=0] Please suggest changes required to resolve this.

Answer 1

We cannot tell you why you are getting a stale datanode. It could be a networking issue. It could be a node that has hardware starting to fail. It could just be that you need to tweak the configuration parameters .