404 query_exemplars in logs

Grafana
1

Hello! Can someone help please? Not sure how to locate the problem

  • What Grafana version and what operating system are you using?
    Grafana CLI version 7.5.10

  • What are you trying to achieve?
    Reduce amount of errors in logs

  • How are you trying to achieve it?
    I’m not sure what to do

  • What happened?
    When my dashboard is opened in browser I’m having a massive amount of 404 errors in logs - 34 input every 5 sec (the dashboard refresh rate).
    My dashboard is working great nevertheless

  • What did you expect to happen?
    I expect no errors :slight_smile:

  • Can you copy/paste the configuration(s) that you are having problems with?
    I have about 100 panels with the Prometheus metrics query like
    app_status_rabbit_value{host="$host"}
    or app_status_rabbit_value{host="$host"}+app_status_value{host="$host"}
    etc

  • Did you receive any errors in the Grafana UI or in related logs? If so, please tell us exactly what they were.

Sep  6 17:47:12 hostname grafana-hostname[2854527]: t=2021-09-06T17:47:12+0300 lvl=info msg="Request Completed" logger=context userId
=1 orgId=1 uname=admin method=GET path=/api/datasources/proxy/1/api/v1/query_exemplars status=404 remote_addr=1.3.4.5 time_ms=0 s
ize=19 referer="https://dashboard.path/LFDCEWFWE/dashboardname?orgId=1&refresh=5s"                                       
Sep  6 17:47:12 hostname grafana-hostname[2854527]: t=2021-09-06T17:47:12+0300 lvl=info msg="Request Completed" logger=context userId
=1 orgId=1 uname=admin method=GET path=/api/datasources/proxy/1/api/v1/query_exemplars status=404 remote_addr=1.3.4.5 time_ms=0 s
ize=19 referer="https://dashboard.path/LFDCEWFWE/dashboardname?orgId=1&refresh=5s"                                       
Sep  6 17:47:12 hostname grafana-hostname[2854527]: t=2021-09-06T17:47:12+0300 lvl=info msg="Request Completed" logger=context userId
=1 orgId=1 uname=admin method=GET path=/api/datasources/proxy/1/api/v1/query_exemplars status=404 remote_addr=1.3.4.5 time_ms=0 s
ize=19 referer="https://dashboard.path/LFDCEWFWE/dashboardname?orgId=1&refresh=5s"
  • Did you follow any online instructions? If so, what is the URL?
    No
2

Hi @alpiua

Did you set or add any exemplars when you configured the Prometheus datasource?

3

Sory for late reply.
No, I didn’t set any exemplars in Datasource.

Still have number of requests in nginx log every time a dashboard is updated.

10.10.10.1 - - [06/Nov/2021:22:32:33 +0200] "POST /api/datasources/proxy/1/api/v1/query_exemplars HTTP/2.0" 404 19 "https://grafana/d/10UU1avnk/name?orgId=1&refresh=1m&123" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:91.0) Gecko/20100
101 Firefox/91.0" "-"                                                                                                                                                                                                                                         
10.10.10.1 - - [06/Nov/2021:22:32:33 +0200] "POST /api/datasources/proxy/1/api/v1/query_range HTTP/2.0" 200 399 "https://grafana/d/10UU1avnk/name?orgId=1&refresh=1m&123" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:91.0) Gecko/20100101
 Firefox/91.0" "-"
4

This topic was automatically closed after 365 days. New replies are no longer allowed.