Tempo querier sends a lot of request and got 206 response code

Grafana Tempo
,
1

image
image3452×1266 398 KB

Hello,

We have observed that the Tempo querier component is sending a large number of requests — approximately 1,500 queries per second (qps) — using the GET method, which results in a 206 response code. However, the request rate from users on the Grafana Tempo UI is about 6 to 20 qps, which seems insufficient to explain the high volume of requests generated by the Tempo querier.

We have two main questions:

  1. What exactly is the querier component accessing? Are these requests being sent to Amazon S3? If so, this could potentially lead to significant S3 costs.
  2. How can we debug the querier to understand what it is specifically requesting?

Thank you for your assistance.

2

I sent the question to Tempo querier sends a lot of request and got 206 response code · grafana/tempo · Discussion #3575 · GitHub ,we can close it here.If anyone is interested, check it out on github,thanks