Mute Timing Not Suppressing Notifications as Expected in Grafana 11.5.2

[kaniskar]

Mute Timing Not Suppressing Notifications as Expected in Grafana

Hello Grafana Community,

I’m experiencing an issue where notifications are still being sent every 2 hours on all Days, despite having set up a mute timing to suppress them. I need help figuring out why this is happening.

Configuration Details

• Mute Timing:
  • Name: “Monday”
  • Time Ranges:
    • Start: 00:00, End: 06:00
    • Start: 06:01, End: 24:00
  • Location: Local time zone
  • Days of the Week: Monday
• Notification Policy:
  • Default policy
  • Mute Timings: "Monday " selected

Expected vs. Actual Behavior

• Expected: No notifications on Mondays, except possibly during the 6:00-6:01 AM window.
• Actual: Notifications are sent every 2 hours throughout all day.

Troubleshooting Steps Taken

• Verified that the mute timing is applied to the correct notification policy.
• Checked that the alert rule is governed by this policy.
• Confirmed that the emails are indeed from the alert rule in question.
• Simplified the mute timing to a single range (00:00 to 23:59) but still received notifications.

Request for Help

Has anyone encountered a similar issue or can spot what might be wrong with my configuration? Any suggestions on how to resolve this would be greatly appreciated.

Thank you in advance for your help!

grafana version 11.5.2

OS : Windows 10.

i have attached the ScreeShot For Further References. let me know where the issues is?

[yuriy.tseretyan]

This is interesting, indeed. I think the problem is that your notification policies do not have matchers. How did you manage to create them? Did you use provisioning? Try to add matchers.

[pythonrulz]

Same problem I am having. I have configured multiple mute timings and even just a blanket 24h mute timing to test and all my alerts are still sent via email. I do have matchers configured as well. Also on 11.5.2. This specific mute timing is for 7am-2pm DST (Chicago)

[user333]

I have the similar problem. I want to set up an alert that triggers at a specific time (for example May 12th between 1pm and 1:10pm). I set it up using an AWS SNS contact point. I always end up getting the notification at the moment of the first evaluation (for example 12:58), at which point the notifications should be muted.

Grafana version: 10.4.1
OS: macOS Sequoia

[pythonrulz]

I found that changing my alert rule to notify a contact point (not a notification policy) and that contact point has mute timings setup it works as it should. This leads me to believe I have an issue with the notification policy that I need to further investigate.

[yuriy.tseretyan]

Please note that if you specify notification settings in rule configuration, it will ignore notification policies! In such cases, Grafana alerting creates a system-owned notification policy that has the settings defined for that rule and matches only that specific rule.