Logs distribution between storages based on tenant

Grafana Loki
1

I have Loki installation that use AWS s3 as logs storage configured as described in the manuals like this:

    storage_config:
      boltdb_shipper:
        shared_store: s3
        active_index_directory: /var/loki/index
        cache_location: /var/loki/cache
        cache_ttl: 336h
      aws:
        s3: s3://eu-central-1/
        bucketnames: mybucket-0,mybucket-1,mybucket-2,mybucket-3
        access_key_id: ${AWS_ACCESS_KEY_ID}
        secret_access_key: ${AWS_SECRET_ACCESS_KEY}
        s3forcepathstyle: true

Now I need to add one more tenant and I have a requirement to store these logs on s3 but in another region in US and then use it ONLY for logs from this tenant.
Is it possible to implement?

2

I’d be using 2 seperate loki instances in that case. That’s what I’m doing. I have 2 containers and expose a different port for each container. You might need another multi-tenant-proxy container but that’s very little overhead. I dont know what app you use to scrape the logs in the first place. I had a little trouble getting the clients: section working in promtail so I switched to fluentd as the sender and , after a bit more fiddling, got that to work.

3

This topic was automatically closed 365 days after the last reply. New replies are no longer allowed.