We have configured grafana 12 using helm chart and enabled the autoscale mode. If the autoscaling happens and pod replicas goes 2 then we see the duplicate alert issues.
I tried grouping the alerts in grafana but its not working. We are not using prometheus alertmanager.
What could be the fix here ?
Hi @jangaraj Thanks, it is helpful however we do not have HA of cluster. Does it applicable in just autoscaling too ?
Yes, you have 2 pods = you have HA. Pods are independent, so each pods running the same set of alerts = you may receive duplicated notifications.
Configure that HA for alerts, so pods will be aware of each other and you will receive single alerts then.
Thanks, will do that.