Grafana Version - 10.0.10 [Enterprise]
OS - Kubernetes Deployment using Helm
-
What are you trying to achieve? - On-prem Enterprise setup of GE, GEL & GEM
-
How are you trying to achieve it? - Using Kubernetes and Helm Charts
-
What happened? - GEL and GEM Pods are giving errors
-
What did you expect to happen? - All Pods running without errors
-
Can you copy/paste the configuration(s) that you are having problems with?
-
Did you receive any errors in the Grafana UI or in related logs? If so, please tell us exactly what they were. -
Error in GEL Read POD -
level=error ts=2024-01-12T11:05:14.186621178Z caller=frontend_scheduler_worker.go:248 msg="error sending requests to scheduler" err="rpc error: code = Unavailable desc = upstream connect error or disconnect/reset before headers. reset reason: connection termination" addr=10.x.x.x:9095
Error in GEM PODs,
ts=2024-01-12T11:06:15.056602804Z caller=gatherer.go:71 level=warn msg="Unable to send system metrics" err="unable to push to distributor: rpc error: code = Unavailable desc = upstream connect error or disconnect/reset before headers. reset reason: connection termination"