How to migrate from single s3 bucket to multiple s3 buckets

[kimxogus]

Hi, I’m using s3 as loki storage with single bucket, and I’m having s3 rate limit issue recently.
so I’d like to use multiple s3 bucket and I don’t know how to migrate single s3 bucket to multiple s3 buckets.

Is there any guide to migrate single s3 bucket to multiple s3 buckets?

[kimxogus]

I found this topic, and the s3_multi config doesn’t work.

Problem with multiple s3 buckets to resolve S3 Rate limit

Hello, I did an upgrade from Loki v2 to v3, and it started to throw a lot of SlowDown: Please reduce your request rate. I tried to tweak the configs, read a lot in issues, docs, slack, community and even chatgpt, but nothing that I did reduced the SlowDown error. Then tried multi tenancy, to avoid the S3 prefix rate limit, but multi tenancy doesn’t work for us because we need to search across all dynamic generated tenants. And now I saw that Loki supports multiples buckets, from the config s3…

[tonyswumac]

I replied to your response in that thread. You don’t have to define S3 bucket under common (in fact that’s the old way of doing it if i remember correctly). Try to simply define it under storage_config.

What I would recommend you to do:

1. Stand up a dev cluster.
2. Find a config that works with multiple S3 buckets.
3. Terminate the dev cluster, and re-deploy with a single S3 bucket (mirroring your production cluster configuration).
4. Attempt to migrate to multiple S3 buckets by adding a new S3 bucket configuration and a new index segment. Test and make sure cluster is functional after migration, and logs from before and after migration are visible.

I unfortunately have never attempted this before, these are just my thoughts.