Hi, I am new to loki and we are trying to setup a shared storage for multiple loki/grafana instances running at different servers.
I looked at boltdb-shipper, which acts as a shared store for chunks/indexes and can ship to ‘GCS bucket’, and I was wondering that:
Would it be possible to ship logs from different on-prem instances of loki to same ‘GCS’ store and then setup a loki/grafana instance on Google Cloud that can consume from this central store to provide us a holistic view of all server logs.
Let’s say we have a GCS bucket named: ‘shared-bucket-xyz’
For simplicity, I am using term logs instead of chunks/indexes since getting centralized logs is the ultimate goal
Can we push logs from local setup to remote shared-bucket-xyz? Cause I don’t see any authentication mechanism in provided configuration options.
Can we push logs from 2 or more local servers to the same bucket shared-bucket-xyz?
Will the cloud deployed loki/grafana stack be able to consume logs from the shared-bucket-xyz?
Configuration Sample provided by Grafana:
schema_config: configs: - from: 2018-04-15 store: boltdb-shipper object_store: gcs schema: v11 index: prefix: loki_index_ period: 24h storage_config: gcs: bucket_name: GCS_BUCKET_NAME boltdb_shipper: active_index_directory: /loki/index shared_store: gcs cache_location: /loki/boltdb-cache
I would greatly appreciate any feedback from the community. Thanks