The Grafana plugins infrastructure seems to be having issues, returning intermittent 504s. This is causing our Grafana pod in GKE to fail to startup by either receiving 504s or incomplete archives when trying to install plugins set via GF_INSTALL_PLUGINS. Is anyone else seeing this issue?
Doing some more investigation on this:
Trying to hit https://grafana.com/api/plugins/grafana-clock-panel/versions/1.0.3/download (as an example) should return a 302 to a github url. Out of 17 requests, 5 returned 504 Gateway Timeout after 2 seconds. I’m trying to install 7 plugins, so getting 7 responses in a row successfully looks to be a fairly slim chance.