Impossible to list multitenant loki datasource alert rules in grafana alerting

Grafana
,
1

Hello,

I have tried grafana 11 (the previous versions have the same issue).
I am using loki deployed with via loki-distributed of latest version and the following structure:

              mountPath: /var/loki/rules/ci-k8s-en1
            - name: loki-operator-rules
              mountPath: /var/loki/rules/ci-k8s
            - name: loki-operator-rules
              mountPath: /var/loki/rules/cit1-k8s
            - name: loki-operator-rules
              mountPath: /var/loki/rules/live-k8s
            - name: loki-operator-rules
              mountPath: /var/loki/rules/global-k8s
            - name: loki-operator-rules
              mountPath: /var/loki/rules/local

We have decided to try grafana alerting, but we faced issue with loki alerts not being listed.

image
image2521×777 42.5 KB

At the same time I see prometheus rules are fine:

image
image2884×585 71.5 KB

Troubelshooting this issue, I have found the following:

[20/May/2024:13:24:30 +0000]  400 "GET /api/prom/rules/test/test HTTP/1.1" 45 "-" "Grafana/10.4.1" "-"

I see grafana tries to fetch some test rule, but obviously this is not possible. Additionally, I am not sure this is possible to provision such rule. I don’t see headers of this request, but I am in doubts it uses correct tenant auth.

I am not sure if this test prevents rules being shown or just grafana is not able to fetch rules from multitenant loki.

This is very improtant issue from perspective of grafana alerting usage.