简体   繁体   English

Elasticsearch 集群故障后 Filebeat 无法发送日志

[英]Filebeat can't send logs after Elasticsearch cluster failure

We recently had a problem when ES cluster failed.我们最近遇到了 ES 集群失败的问题。 The problem was resolved, but filebeat failed to send new data after the failure.问题解决了,但是filebeat失败后发送新数据失败。
Here's a portion of the logs - it seems to retry forever but can't send the data:这是日志的一部分 - 它似乎永远重试但无法发送数据:

2019-04-08T11:52:04.182+0300    INFO    elasticsearch/client.go:690    Connected to Elasticsearch version 6.4.0
2019-04-08T11:52:04.185+0300    INFO    template/load.go:73    Template already exists and will not be overwritten.
2019-04-08T11:52:04.185+0300    INFO    [publish]    pipeline/retry.go:172    retryer: send unwait-signal to consumer
2019-04-08T11:52:04.185+0300    INFO    [publish]    pipeline/retry.go:174      done
2019-04-08T11:52:59.058+0300    INFO    [publish]    pipeline/retry.go:149    retryer: send wait signal to consumer
2019-04-08T11:52:59.058+0300    INFO    [publish]    pipeline/retry.go:151      done
2019-04-08T11:53:00.065+0300    ERROR    pipeline/output.go:92    Failed to publish events: temporary bulk send failure
2019-04-08T11:53:00.065+0300    INFO    [publish]    pipeline/retry.go:172    retryer: send unwait-signal to consumer
2019-04-08T11:53:00.065+0300    INFO    [publish]    pipeline/retry.go:174      done
2019-04-08T11:53:00.065+0300    INFO    [publish]    pipeline/retry.go:149    retryer: send wait signal to consumer
2019-04-08T11:53:00.065+0300    INFO    [publish]    pipeline/retry.go:151      done

I restarted Filebeat service and all data was sent to ES without any problem.我重新启动了 Filebeat 服务,所有数据都毫无问题地发送到 ES。
Is this a known issue?这是一个已知的问题? Filebeat version is quite old, should I update? Filebeat 版本很旧,我应该更新吗?
I'm running Filebeat 6.3.0 as a service on Windows.我在 Windows 上将 Filebeat 6.3.0 作为服务运行。 Elasticsearch version is 6.4.0. Elasticsearch 版本是 6.4.0。

Please show your profile请出示您的个人资料
I have encountered this error before because I did not write the procotol我之前遇到过这个错误,因为我没有写procotol
Below is a correct configuration file下面是正确的配置文件

filebeat.inputs:
- type: log
  enabled: true
  paths:
  - /var/log/dmesg
  - /var/log/syslog

output.elasticsearch:
  # Array of hosts to connect to.
  hosts: ["http://192.168.13.173:30014"]

description : https://www.elastic.co/guide/en/beats/filebeat/current/elasticsearch-output.html描述: https : //www.elastic.co/guide/en/beats/filebeat/current/elasticsearch-output.html

声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.

 
粤ICP备18138465号  © 2020-2024 STACKOOM.COM