How can I configure Grafana to not combine multiple alerts?

Grafana Alerting
1

Hi there,

Today I noticed that my alerts mails arrived with multiple alerts combined in a single mail. This is annoying for me because I can’t:

  • immediately see which are firing or fired by scanning mail subjects.
  • mark specific alert mails as read because it’s handled or recovered, but not the other one which I need to investigate further.

So, is there a way to restore the old behavior and send each alert separately?

2

Welcome @lilydjwg to the Grafana forum.

I have not personally tried this, but I believe creating different Groups (in the box shown below) will cause them to get evaluated (and hopefully sent) separately. Please give it a try and let us know if that works or not.

image
image1379×681 51.9 KB

3

That sounds promising, but my alerts already have different groups. They are the same as my rule names, perhaps due to migration after some upgrade. However, there are many warnings in the logs:

logger=ngalert t=TIME level=warn msg="rule declares one or many reserved labels. Those rules labels will be ignored" labels="alertname=xxx load alert"