Relationship between loki_chunk_store_stored_chunks_total and object in S3 bucket

Grafana Loki
1

We’ve been informed by our S3 object storage provider that we’re getting close to their default limit 10 million objects in a bucket and they’e asked us to provide estimation about future growth of the number of objects in the bucket.

Looking at the Loki metrics the loki_chunk_store_stored_chunks_total metric should represent this best, but according to the metric we have about 450k chunks, but there are 1.9 million objects in the bucket.

I was looking for further information about the exact layout of the chunks storage to understand this mismatch, but came up empty up to now.

Did someone already look into such a topic?

2

The metric represents how many chunks have been written to storage since the container is up, it’s not a representation of how many files you actually have in your storage.

1 Like
3

Thanks a lot for your feedback. That thought somehow didn’t occur to me, since the metrics where overlapping so perfectly between all three instances.