Unable to PUT when using s3 configuration with loki chart

Hello,

I’m using the simple “loki” chart version 3.2.1 from Grafana Community Kubernetes Helm Charts | helm-charts (which I believe is the chart moved to loki/production/helm/loki at main · grafana/loki · GitHub, formerly the simply scalable one) and I’m a bit unclear in how to setup correctly the s3 storage.

I have the following values:

        monitoring:
          selfMonitoring:
            enabled: false
            lokiCanary:
              enabled: false
            grafanaAgent:
              installOperator: false
          rules:
            enabled: false
          alerts:
            enabled: false
          serviceMonitor:
            enabled: false
        loki:
          auth_enabled: false
          commonConfig:
            replication_factor: 1
          storage:
            type: 's3'
            bucketnames:
              admin: ae-loki-logging-admin
              chunks: ae-loki-logging-chuncks
              ruler: ae-loki-logging-ruler
          s3:
            endpoint: https://s3.eu-west-1.amazonaws.com
            region: eu-west-1
            secretAccessKey: <secret>
            accessKeyId: <key>
        read:
          replicas: 1
          nodeSelector:
            app: infra
          tolerations:
          - key: "app"
            operator: "Equal"
            value: "infra"
            effect: "NoSchedule"
          persistence:
            size: 16Gi
        write:
          replicas: 2
          nodeSelector:
            app: infra
          tolerations:
          - key: "app"
            operator: "Equal"
            value: "infra"
            effect: "NoSchedule"
          persistence:
            size: 32Gi
        gateway:
          nodeSelector:
            app: infra
          tolerations:
          - key: "app"
            operator: "Equal"
            value: "infra"
            effect: "NoSchedule"
          image:
            tag: 1.23-alpine

Now, when I deploy this and send things to Loki, what I see in write logs is this

level=error ts=2022-10-07T16:57:29.644823039Z caller=flush.go:146 org_id=fake msg="failed to flush user" err="store put chunk: RequestError: send request failed\ncaused by: Put \"https://chunks.s3.dummy.amazonaws.com/fake/93b70bc01000c7c0/183b31afd82%3A183b31bd4a7%3Aceeba107\": dial tcp: lookup chunks.s3.dummy.amazonaws.com on 10.100.0.10:53: no such host"

No matter what I specify for endpoint of bucketnames, the url is ‘chunks.s3.dummy.amazonaws’. I’ve looked at various examples and so on, but I’m left unclear as to the following:

  • what should the s3.endpoint be (as per values file in the repo)
  • what should s3.s3 be (as per values file in the repo)

I’m doing something wrong but not entirely sure what