使用 EKS 中的流利位在 AWS cloudwatch 中自动创建日志组

Question

Is there a way to automatically ship the logs from EKS pods to cloudwatch using fluent bit whenever new pods come up? I am able to send the logs by adding INPUT, FILTER, OUTPUT section in fluent-bit configmap whenever we need to deploy a new service. But this process is cumbersome. Is there a way to automate this part? like when we do a new deployment, fluent bit sees the new pods and ships the log to specific log group in cloudwatch.

Thanks in advance.

Answer 1

Your input paths have specific expression that capture only certain logs:

/var/log/containers/ grafana .log

/var/log/containers/ memsql .log,/var/log/containers/ studio .log

No custom location seen in your config. Anyway, you can follow EKS container insights (with fluent-bit) here which you do not need to change your config every time a new workload is introduced.