如何在grok（logstash）中将模式“ a = bc = d”与顺序更改进行匹配？

Question

I'm using Logstash to match Fortinet analyzer logs, and the problem is there are so many pattern without order of the fields.

eg one type of message would be:

service=DNS hostname="abnet" profile="Dns" action=blocked reqtype=direct url="/" sentbyte=0 rcvdbyte=0 direction=N/A msg="URL belongs to a denied category in policy" method=domain cat=61 catdesc="Phishing" crscore=60 crlevel=high

...and another is:

msg="File is infected." action=blocked service=HTTP sessionid=33137 direction=incoming filename="favicon.ico" quarskip=No-skip virus="MSWord/Agent.DD60!tr" dtype="Virus" ref="http://www.fortinet.com/ve?vn=MSWord%2FAgent.DD60%21tr" virusid=6920465 profile="AV"

As you can see both have msg , action , service and profile but with different order.

Is there anyway to build a pattern to match something like:

(.*?)=%{DATA:\1?}\s 

...while giving the field the name of the first match?

Answer 1

使用kv {}过滤器可以将其全部拆分，而不关心顺序。