Kubernetes Prometheus: Add alert when container memory usage is greater than total kube node memory capacity

Question

I am monitoring several kubernetes clusters with Prometheus.

I want an alert rule that fires, when the total container memory usage exceeds or is equal to the total kube node memory capacity.

What I constructed is the following:

sum(container_memory_usage_bytes{instance=~"sa.*.domain"}) >= sum(kube_node_status_capacity_memory_bytes{node=~"sa.*.domain"})

but in the expression evaluator in the Prometheus GUI I get a numerical value back when I test this expression.

Can someone help me with the right expression?

Thanks in advance.

Best regards, rforberger

Answer 1

I have rebuild the query, and have a question regarding it. I will open another question.