Loki with swift storage

Grafana Loki
1

Has anyone swift as storage for loki? There looks to be experimental support for it in cortex and I am wondering if anyone had any success with it. I am following the example documentation at Examples | Grafana Labs and trying to plug in the swift config options from Configuration file | Cortex

I receive the following error when trying to start loki:

root@loki-distributor01:~# ./loki-linux-amd64 -log.level debug -config.file=loki-zero-dep-swift.yaml
level=info ts=2021-07-26T22:04:11.278228294Z caller=main.go:130 msg="Starting Loki" version="(version=2.2.1, branch=HEAD, revision=babea82e)"
level=info ts=2021-07-26T22:04:11.278487414Z caller=server.go:229 http=[::]:3100 grpc=[::]:9095 msg="server listening on addresses"
level=info ts=2021-07-26T22:04:11.278606239Z caller=modules.go:477 msg="RulerStorage is not configured in single binary mode and will not be started."
level=warn ts=2021-07-26T22:04:11.278686888Z caller=experimental.go:19 msg="experimental feature in use" feature="OpenStack Swift Storage"
level=error ts=2021-07-26T22:04:11.476563509Z caller=log.go:106 msg="error running loki" err="Response didn't have storage url and auth token\nerror initialising module: table-manager\ngithub.com/cortexproject/cortex/pkg/util/modules.(*Manager).initModule\n\t/src/loki/vendor/github.com/cortexproject/cortex/pkg/util/modules/modules.go:105\ngithub.com/cortexproject/cortex/pkg/util/modules.(*Manager).InitModuleServices\n\t/src/loki/vendor/github.com/cortexproject/cortex/pkg/util/modules/modules.go:75\ngithub.com/grafana/loki/pkg/loki.(*Loki).Run\n\t/src/loki/pkg/loki/loki.go:220\nmain.main\n\t/src/loki/cmd/loki/main.go:132\nruntime.main\n\t/usr/local/go/src/runtime/proc.go:204\nruntime.goexit\n\t/usr/local/go/src/runtime/asm_amd64.s:1374"

Configureation file is:

auth_enabled: false

server:
  http_listen_port: 3100
  log_level: debug

distributor:
  ring:
    kvstore:
      store: memberlist

ingester:
  lifecycler:
    ring:
      kvstore:
        store: memberlist
      replication_factor: 1
    final_sleep: 0s
  chunk_idle_period: 5m
  chunk_retain_period: 30s

memberlist:
  abort_if_cluster_join_fails: false

  bind_port: 7946

  join_members:
  - <REDACTED>

  max_join_backoff: 1m
  max_join_retries: 10
  min_join_backoff: 1s

schema_config:
  configs:
  - from: 2020-05-15
    store: boltdb-shipper
    object_store: swift
    schema: v11
    index:
      prefix: lok_index_
      period: 24h

storage_config:
  boltdb_shipper:
    active_index_directory: /loki/index
    cache_location: /loki/index_cache
    shared_store: swift

  swift:
    auth_url: https://identity.api.rackspacecloud.com/v2.0
    username: <REDACTED>
    password: <REDACTED>
    container_name: <REDACTED>
    region_name: <REDACTED>

limits_config:
  enforce_metric_name: false
  reject_old_samples: true
  reject_old_samples_max_age: 168

Thanks,
Chris

2

This topic was automatically closed 365 days after the last reply. New replies are no longer allowed.