Loki Queriers Give Error Fetching Chunks, Context Canceled on Grafana Queries

My team currently has a Loki Distributed cluster up and running in an on prem kubernetes cluster that has been working well for the most part. However, when we query from Grafana we will see error logs in a querier that says

msg=“error fetching chunks” err=“context canceled”

Data will still return in Grafana and looks to be correct. I’m not seeing any errors in the Query Frontend pods.

Has anyone else experienced an error similar to this?