Login POST not reaching Grafana

  • What Grafana version and what operating system are you using?
    Grafana 8.0.6 – Centos 7

  • What are you trying to achieve?
    Get past login screen.

  • How are you trying to achieve it?
    user http request port 3200–> minikube → node: http-proxy to gateway → node-proxy to docker on port 9092 (Gateway X – referred to later) → grafana

  • What happened?
    I can request the web page to login, and it is delivered to the client (log seen in grafana-sever). When populating the form for admin / admin in firefox and “Login”, it hangs on “Logging in…” and a POST is seen in firefox developer, and is also seen at Gateway X. There is no log generated in grafana that it ever received it.

A curl command does reach grafana and shows “Login Sucessful”:
curl -d “user=admin&password=admin” -X POST http://172.17.0.2:32000/grafana/login
(this passes through the same infrastructure to reach grafana as the browser request)

  • What did you expect to happen?
    Firefox to be able to login

  • Can you copy/paste the configuration(s) that you are having problems with?
    [server]
    protocol = http
    http_addr =
    http_port = 9092
    domain = localhost
    enforce_domain = false
    root_url = %(protocol)s://%(domain)s:%(http_port)s/grafana
    serve_from_sub_path = true
    enable_gzip = true
    read_timeout = 0

  • Did you receive any errors in the Grafana UI or in related logs? If so, please tell us exactly what they were.
    This is displayed in the logs AFTER I refresh / navigate away

  • Did you follow any online instructions? If so, what is the URL?
    No

Added snapshots:
Beyond compare diff of curl vs browser at Gateway X:

hung page with post that was received at Gateway X:

minikube services:
image

kubectl services:

gateway proxy:

*-gateway:
image