Grafana Alerts firing twich on Teams

Grafana Alerting
1

Hello,

Our Grafana alert policy is configured as can be seen below. I have two questions:

  1. I may be misunderstanding something but it keeps firing twice to Microsoft Teams. Any help will be greatly appreciated.

  2. I need help with timing logic. What I want is an alert firing once conditions are met and to repeat every 12 hours. If conditions change I want a new alert firing.

teamalert
teamalert1050×1560 37.9 KB

alertrule
alertrule2089×1711 79.7 KB

alerttag
alerttag2149×1534 92.4 KB

notpolicy
notpolicy2119×928 16.5 KB

contactpoint
contactpoint1879×1054 16.2 KB

Thank you for any help extended,

-Shai

2

Any help? I know grafanacon was going on last week - if anyone freed up I would greatly appreciate assistance.

3

Hi! :wave: Are you running Grafana with high availability? If so, have you followed the instructions here?

4

We are using Azure Managed Grafana. From an initial search there doesn’t seem to be a way to edit the availability in Azure Managed Grafana and I’m unaware of a way to edit config files

5

It sounds like you are having the same issue as Grafana Alert sent 3 alert notifications at once - #22 by dmytrodrachov.

6

Thanks for your help!

Maybe, though I am in Azure not AWS. If it’s a bug is there a support ticket open for it?

7

I would ask support if you can because it looks like a case of duplicate notifications due to incorrect HA configuration.