Grafana alerting Evaluation

Grafana Alerting
,
1

Hello ,
Generally i am creating an cpu alert rule in grafana for proemetheus datasource.
Here i want to get the alert to evaluate for every 24hrs.
Where i have to mention this.For every 24 hrs i want the condition to be checked.

And also is there any solution to disable the alert for if there are no alerts for that particular rule for last 24hrs.
Can anyone clarify.
Thanks in advance

2

hi @vallabhanenisai1999

please share your data source and grafana version

how does the configuration of your alert (evaluation interval) looks like?

here i want to get the alert to evaluate for every 24hrs.

See Evaluate every in step 3 when creating a new alert rule

and also is there any solution to disable the alert for if there are no alerts for that particular rule for last 24hrs.

See Evaluate for when creating a new alert rule

Documentation:

3

Currently I am using prometheus as datasource and grafana version 8.3.5
I have installed using loki stack helm chart.

IMG20230404135019
IMG202304041350191920×1080 96.9 KB

I have shared you the image for that i am trying to get for every 24 hrs

IMG20230404135133
IMG202304041351331920×1080 122 KB

IMG20230404135123
IMG202304041351231920×1080 92.8 KB

4

Can you please clarify
@antonio

5

try Evaluating every 24h or 1440m

Not sure this can be done but what you can do is decide how long the limit of your condition (e.g let’s say your limit is 10) must be true before the alert fires. This is the for part of the evaluation. For instance fire the alert if the value of my query is 10 during 5 min.

Once a condition is breached, the alert goes into the Pending state. If the condition remains breached for the duration specified, the alert transitions to the Firing state, otherwise it reverts back to the Normal state. After 24 hours the condition of the alert will be evaluated again.

6

evaluate every which time and what value in for
can you share that interval

7

@vallabhanenisai1999
If you set these settings:

Evaluate every: 24h
for: 0s

With your current query the alert will:

  1. Evaluate once every 24h

  2. Sum the value of the rate of container_memory_usage_bytes for the past 24h interval

  3. Is the last value of the rate is more than 10?

  4. If the value exceeds the limit (10) for more than 0 seconds (fire immediately).

                        -OR-

You can also adjust the for parameter if you don’t want to fire immediately. For example, if you want it to only fire if the limit is still exceeded after the condition is next evaluated (in 24 hours) then set for to 24h. Note that the alert will remain pending until 24h has elapsed