Helm Grafana+Prometheus - Alerting GUI - Need to refresh every time

Grafana Prometheus
1

  • What Grafana version and what operating system are you using?
    RKE cluster (Redhat 8.5)
    Rancher monitoring Helm chart BUT changed to use official grafana image.
    Deployed behind an Ingress nginx without subpath (access via grafana.domain.com)

  • What are you trying to achieve?
    Create Dashboards with alerts. Trying to create a panel using new CANVAS feature to improve system visualization.

  • How are you trying to achieve it?
    Deployed Rancher monitoring Helm chart and update grafana from grafana/grafana docker image.
    image

  • What happened?
    From alerts section, i receive 404 not found when i try to view, edit an alert. But if i refresh the webpage, i can access to the rule. Seems to happen when url is /alerting

  • What did you expect to happen?
    Accessing to alerting GUI without refresh.

  • Can you copy/paste the configuration(s) that you are having problems with?
    Ingress configuration:

apiVersion: networking.k8s.io/v1
kind: Ingress
metadata:
  annotations:
    meta.helm.sh/release-name: monitoring
    meta.helm.sh/release-namespace: monitoring
  generation: 1
  labels:
    app.kubernetes.io/instance: monitoring
    app.kubernetes.io/managed-by: Helm
    app.kubernetes.io/name: grafana
    app.kubernetes.io/version: 9.4.3
    helm.sh/chart: grafana-6.16.14
  name: monitoring-grafana
  namespace: monitoring
spec:
  ingressClassName: nginx
  rules:
  - host: grafana.domain.local
    http:
      paths:
      - backend:
          service:
            name: monitoring-grafana
            port:
              number: 80
        path: /
        pathType: Prefix

grafana.ini:

data:
  grafana.ini: |
    [analytics]
    check_for_updates = true
    [auth]
    disable_login_form = false
    [auth.anonymous]
    enabled = false
    org_role = Viewer
    [auth.basic]
    enabled = true
    [dashboards]
    default_home_dashboard_path = /tmp/dashboards/rancher-default-home.json
    [grafana_net]
    url = https://grafana.net
    [live]
    allowed_origins = https://*.domain.local
    [log]
    mode = console
    [paths]
    data = /var/lib/grafana/
    logs = /var/log/grafana
    plugins = /var/lib/grafana/plugins
    provisioning = /etc/grafana/provisioning
    [security]
    allow_embedding = true
    [server]
    root_url = https://grafana.domain.local
    [users]
    auto_assign_org_role = Viewer

  • Did you receive any errors in the Grafana UI or in related logs? If so, please tell us exactly what they were.
    Grafana UI showing the 404 not found page

  • Did you follow any online instructions? If so, what is the URL?
    no

Thanks :slight_smile: