Failed to pull image - docker.io/grafana/loki:2.9.4 ( even with more recent builds like 3.4.* )

Hi dear Grafana team, this is my first post ever :slight_smile:
I’ve been stalking the forum here and there for few years without actually need to open a new request but this time I’ve a small doubt there might be some issues on the image repo.

Today ( around 8:00 AM CET 01/04/2026 ) we had to restart loki workloads for some other management needs and since then no loki pod were able to start due to this error:

Failed to pull image "docker.io/grafana/loki:2.9.4": rpc error: code = NotFound desc = failed to pull and unpack image "docker.io/grafana/loki:2.9.4": failed to unpack image on snapshotter overlayfs: unexpected media type text/html for sha256:68af886ddf88956267ecc82d9a649c73d56a931fb6c4fb56ad7e8a6d3862f553: not found

Do you have any clue about what this error could be? Is it due to some issues on “docker.io/grafana” ? ( UPDATE 1: issue on docker.io excluded ) Or might it be a problem on our filesystem?

For curiosity, we have also tried with more recent builds like the 3.4.* but still same issue:

Failed to pull image "docker.io/grafana/loki:3.4.0": rpc error: code = NotFound desc = failed to pull and unpack image "docker.io/grafana/loki:3.4.0": failed to unpack image on snapshotter overlayfs: unexpected media type text/html for sha256:68af886ddf88956267ecc82d9a649c73d56a931fb6c4fb56ad7e8a6d3862f553: not found

Please let me know :slight_smile:
Thank you very much for your very good product and the big help given to the community through all these years

Thank you and Regards

UPDATE 1:
The issue is not related to the image repo, i’ve tried a very fast pull from my local machine and worked fine. It might be due to a recent os patch on the cluster.
Will provide further updates as soon as we discover