Alerts firing more often than expected

Grafana Alerting
,
1

Hi,

I have a few alerts that are alerting more often than expected. I initially set the evaluation time to 4hrs, then increased both the evaluation time and pending period to 12 hrs. However, I just got some alerts that were firing every 4 hours. I have my contact points set to a template email and also to send a single email to all recipients. Does any have any insight into this issue?

Thanks!

2

I just wanted to follow up here with some more info and examples.

Here are some timestamps of emails being sent for the same alert 4 hours after each other.

image
image
image

Here is the state history of this alert, which doesn’t seem to align with the emails:

image
image2945×411 31 KB

Here’s confirming that the pending period and evaluation time are set to 1d:

image
image990×237 13.3 KB

Any help would be greatly appreciated, as this bug has been spamming inboxes each time there is an issue.

3

Alert is not firing every 4 hours. But notification is repeated every 4 hours by default. Configure repeat interval for your need:

4

This worked thank you!