Loki backend is failing with invalid tsdb path: /var/loki/tsdb-shipper-cache/tenant1

[praveenrekhapalli]

Hi I am using Loki 3.5.0 and have multi tenant setup with the logs written to Azue adls storage using use_thanos_objstore: true as it is the default way to configure storage in a future releases but what I observed is the below error. when the store is intialized it is downloading all the indexes and is downloading the tenant1 as a file and creating it as a file but then showing the invalid tsdb path as it is expecting a folder. The same setup is working without using the thanos_objstore. The tenant1 contains the compaction file. the below is the message it shows ts=2025-06-30T09:42:05.906243709Z caller=spanlogger.go:116 table-name=tsdb_index_20268 level=error msg=“failed to initialize table, cleaning it up” table=tsdb_index_20268 err=“invalid tsdb path: /var/loki/tsdb-shipper-cache/tsdb_index_20268/tenant1” and cleaning it up but after sometime it is failing and even I don’t see the cleaning it up message for the second time. I believe the fetching of index using object_store is done differently and when iisting the files there should be a logic to not consider files with size 0