- What Grafana version and what operating system are you using?
Grafana OSS v8.2.1
- What are you trying to achieve?
Send notifications for multi-dimensional alerts
- How are you trying to achieve it?
We are trying to play around with the new Unified Alerting from Grafana 8. We created a Grafana managed alert based on InfluxDB data-source with multi-dimensional capabilities.
We have a request returning multiple series (memory usage of a particular binary), that is reduced with a Max operation. We then configured a threshold for the alert and assigned a “team” label to the alert.
We want to send alert notifications through mail so we created a “test-email” contact-point. A notification policy routes all alerts matching with tag “team=my-team” to the “test-email” contact-point.
- What happened?
The alert properly triggers with every combination of tags that triggered it but we receive a new email every 4 hours, with the exact same combination of tags and the exact same status (the alert fired and never resolved)
- What did you expect to happen?
The alert should trigger once, and we should receive a single email, not every 4 hours with the exact same state.
Can you copy/paste the configuration(s) that you are having problems with?
Did you receive any errors in the Grafana UI or in related logs? If so, please tell us exactly what they were.
Did you follow any online instructions? If so, what is the URL?
We followed the Create Grafana managed alert section of the documentation.