# Alert for every error in logs

**URL:** <https://community.grafana.com/t/alert-for-every-error-in-logs/45997>\
**Category:** Grafana Loki\
**Tags:** loki, alerting\
**Created:** [April 13, 2021, 2:18pm UTC](https://community.grafana.com/t/alert-for-every-error-in-logs/45997 "2021-04-13T14:18:29Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![luciferinlove](https://avatars.discourse-cdn.com/v4/letter/l/278dde/32.png) [@luciferinlove](https://community.grafana.com/u/luciferinlove)\
**Post date:** [April 13, 2021, 2:18pm UTC](https://community.grafana.com/t/alert-for-every-error-in-logs/45997/1 "2021-04-13T14:18:29Z")

</div>

Hello. I want to receive an alert on every error in logs. I have Logstash now and it sends me emails on every error in some application. But I can’t sort out how to do it in Loki. I’ve tried several rules like:

```auto
- alert: ErrorsInAppLogs
  expr: |
    sum(count_over_time({label="app",level="error"} | regexp `(?P<log>.+)`[5m])) by (log, label, container, hostname, job, logger, pod) > 0
  for: 15s
  labels:
    severity: critical

```

and

```auto
- alert: ErrorsInAppLogs
  expr: |
    count_over_time({label="app",level="error"}[5m]) > 0
  for: 15s
  labels:
    severity: critical

```

In both cases, I’ve received either zero or double alerts for errors in logs. But Logstash still sent emails on every error without doubling or skipping.  
Alertmanager config:

```auto
global:
  smtp_from: some@email.com
  smtp_smarthost: smtp.email.com:587
  smtp_hello: smtp.email.com
  smtp_auth_username: some@email.com
receivers:
- name: admins
  email_configs:
  - to: me@email.com
    send_resolved: true
    html: '{{ template "email.html" . }}'
    headers:
      subject: '{{ template "email-subject" . }}'
- name: logs
  email_configs:
  - to: me@email.com
    send_resolved: false
    html: '{{ template "email.html" . }}'
    headers:
      subject: '{{ template "email-subject" . }}'
inhibit_rules:
- source_match:
    severity: critical
  target_match:
    severity: warning
  equal:
  - alertname
route:
  group_by:
  - job
  - node
  group_interval: 1s
  group_wait: 1s
  receiver: admins
  repeat_interval: 12h
  routes:
  - receiver: logs
    repeat_interval: 10m
    match_re:
      alertname: ErrorsInAppLogs
templates:
- '*.tmpl'

```

With the settings above, I receive a duplicate message after 5 or more minutes or don’t receive one. Is it possible to get an alert for every single error in logs? It doesn’t matter if the alerts are grouped or not. I just don’t want Loki to skip or duplicate alerts. Thanks in advance.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/grafana/original/2X/e/ef5308cc58c9e5a13187b5012eb99f406928462f.png) [@system](https://community.grafana.com/u/system)\
**Post date:** [April 13, 2022, 2:19pm UTC](https://community.grafana.com/t/alert-for-every-error-in-logs/45997/2 "2022-04-13T14:19:09Z")

</div>

Closed on April 13, 2022, 2:19pm UTC

This topic was automatically closed 365 days after the last reply. New replies are no longer allowed.
