I have this PROMQL query used as the alert query which calculates the average as :- sum by(Label1,Label2) (histogram_metric_sum)/ count by(Label1,Label2) (histogram_metric_sum)
Consider Label1, Label2 as Label1 - City, Label2 - Street, where the average pollution in the area is measured by a histogram metric, as defined in the query. Now if the pollution value exceeds the defined threshold value of 1.5, using the threshold expression feature in Grafana alert creation, an alert will be fired, evaluated at a 5 minute interval period.
However, if the same City,Street Combination label’s average value has exceeded in the future again, I do not want the same alert to be fired again for the SAME City-Street Combination.
Currently this is what is happening. I am wondering how to solve this problem if Grafana supports some way to Group alerts by Labels?