I have Grafana charts showing NetApp Storage Disk Utilization.
I have setup alert, if Disk utilization is 99% for 5 mins, send alerts via Slack Channel.
When the disk utilization related to a RAID Group meets this condition, an alert pops in Slack channel with the name of the RAID group having high disk utilization. However, when the condition gets resolved, the Alert in Slack channel shows Value: [no value].
Before I explain what’s happening here, it sounds to be like you want to be using multi-dimensional alerting via either a Reduce + Math or Threshold expressions, rather than Classic Conditions.
In Classic Conditions, each alert rule can fire at most one alert. If there is more than one series that has exceeded the condition, then these are shown in the ValueString as can be seen in the first example.
If there are two series that had exceeded the condition, but now one of them has resolved, you won’t get a resolved notification because there is still one series that has exceeded the condition. The alert will still be firing, just the text in the Value field will change at the next repeat_interval.
If all series have resolved then the alert will also be resolved. [no value] means that there are no firing metrics for the Classic Condition.
It sounds to be that you would like to get a notification which each series exceeds the condition and is resolved. This is where I would recommend using a Reduce + Math expression, or a Threshold expression, instead of a Classic Condition, and in doing so allow you to use multi-dimensional alerting.
