logstash不将日志推送到AWS Elasticsearch

Question

我试图将日志从logstash推送到elasticsearch，但是失败了。 这是我的logstash.conf文件：

input {
            file {
                    path => "D:/shweta/ELK_poc/test3.txt"
                    start_position => "beginning"
                    sincedb_path => "NUL"
                    ignore_older => 0
                }}

    output {
        elasticsearch {
            hosts => [ "https://search-test-domain2-2msy6ufh2vl2ztfulhrtoat6hu.us-west-2.es.amazonaws.com" ]
            index => "testindex4-5july"
            document_type => "test-file"
        }
    } 

我在主机中提供的ES端点是open，因此不应出现访问问题，但仍会出现以下错误：

_[2018-07-05T13:59:05,753][INFO ][logstash.outputs.elasticsearch] Running health check to see if an Elasticsearch connection is working {:healthcheck_url=>https://search-test-domain2-2msy6ufh2vl2ztfulhrtoat6hu.us-west-2.es.amazonaws.com:9200/, :path=>"/"}_
_[2018-07-05T13:59:05,769][WARN ][logstash.outputs.elasticsearch] Attempted to resurrect connection to dead ES instance, but got an error. {:url=>"https://search-test-domain2-2msy6ufh2vl2ztfulhrtoat6hu.us-west-2.es.amazonaws.com:9200/", :error_type=>LogStash::Outputs::ElasticSearch::HttpClient::Pool::HostUnreachableError, :error=>"Elasticsearch Unreachable: [https://search-test-domain2-2msy6ufh2vl2ztfulhrtoat6hu.us-west-2.es.amazonaws.com:9200/][Manticore::ResolutionFailure] This is usually a temporary error during hostname resolution and means that the local server did not receive a response from an authoritative server (search-test-domain2-2msy6ufh2vl2ztfulhrtoat6hu.us-west-2.es.amazonaws.com)"}_

我被困在这里。 但是，当我下载ES并将其安装到我的计算机中并在本地运行时，在输出中将hosts => [ "localhost:9200" ]替换为： hosts => [ "localhost:9200" ] ，它可以很好地将数据推送到本地es：

我尝试了很多方法，但无法解决问题，任何人都可以帮忙。 我不想提供本地主机，但要提供AWS ES域终端节点。 任何提示或线索将不胜感激

在此先感谢Shweta

Answer 1

我认为，您只需要显式添加端口443，它就可以工作。 我认为，如果未明确指定端口 ， elasticsearch输出插件会自动使用端口9200 。

    elasticsearch {
        hosts => [ "https://search-test-domain2-2msy6ufh2vl2ztfulhrtoat6hu.us-west-2.es.amazonaws.com:443" ]
        index => "testindex4-5july"
        document_type => "test-file"
    }

另一种选择是不添加端口，而是指定ssl => true ，如官方AWS ES文档中所述

    elasticsearch {
        hosts => [ "https://search-test-domain2-2msy6ufh2vl2ztfulhrtoat6hu.us-west-2.es.amazonaws.com" ]
        index => "testindex4-5july"
        document_type => "test-file"
        ssl => true
    }