AWS Cloudwatch通过Kinesis Firehose登录到ElasticSeacrh
[英]AWS Cloudwatch logs to ElasticSeacrh via Kinesis Firehose
问题描述
I am trying to stream AWS cloudwatch logs to Amazon ES using Kinesis Firehose. 
我正在尝试使用Kinesis Firehose将AWS cloudwatch日志流式传输到Amazon ES。 However, I keep getting the below errors in the ES error log. 但是，我在ES错误日志中不断收到以下错误。 Any idea? 任何想法？
The data could not be decoded as UTF-8 as in {"attemptsMade":0,"arrivalTimestamp":1494910856979,"errorCode":"InvalidEncodingException","errorMessage":"The data could not be decoded as UTF-8","attemptEndingTimestamp":1494911157268,"rawData":"H4sIAAAAAAAAADWO0QqCMBiFX2XsWiJBQ70LUW8sIYUuQmLpnxvpJttMQnz3ZtrlxzmcQj0RXNBWNMkErmkSKoTfZSrmWQLoV1fBQlWS9ZoLHrNUgFQ5u5a8XvYHrBSfM6rWumdHQpDNjtuM7vr333IPnOtZfbxG4pmjTQ5tegEIK1YvxBlEgraZIPFFtlhgnyzOKmQQqFOzwXM5fj/HcTewAAAA=","esDocumentId":null 无法像{“ attemptsMade”：0，“ arrivalTimestamp”：1494910856979，“ errorCode”：“ InvalidEncodingException”，“ errorMessage”：“中所述，将数据解码为UTF-8：”无法解码数据为UTF-8" ， “attemptEndingTimestamp”：1494911157268 “RAWDATA”： “H4S IAAAAAAAAADWO0QqCMBi FX2XsWiJBQ70LUW8sIYU uQmLpnxvpJttMQnz3Ztr lxzmcQj0RXNBWNMkErmk SKoTfZSrmWQLoV1fBQlW S9ZoLHrNUgFQ5u5a8XvY HrBSfM6rWumdHQpDNjtu M7vr333IPnOtZfbxG4pm jTQ5tegEIK1YvxBlEgra ZIPFFtlhgnyzOKmQQqFO zwXM5fj / HcTewAAAA =”， “esDocumentId” ：空值
1 个解决方案
解决方案1
1 2017-06-08 04:59:02
This is most probably because Cloudwatch logs are compressed. 这很可能是因为Cloudwatch日志已压缩。 You can use a Firehose transformation lambda blueprint and add code to uncompress the records. 您可以使用Firehose转换lambda蓝图并添加代码以解压缩记录。
声明:本站的技术帖子网页，遵循CC BY-SA 4.0协议，如果您需要转载，请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.