Duplicated alert issue

Hello team,

I have an issue regarding to Grafana alerting, we can see grafana pushing a lot of notifications by reading this graph.

image

That’s weird, because alerts should only be pushed before system abnormal occurs and after problems been solved

image

Did you look at this? Specifically:

  • Evaluate every - Specify how often the scheduler should evaluate the alert rule. This is referred to as the evaluation interval .
  • For - Specify how long the query needs to violate the configured thresholds before the alert notification triggers.