Hello, we’re not able to find logs, I think it’s not pushing to our Grafana Cloud instance.
Here’s our config
logs:
configs:
- clients:
- url: https://logs-prod3.grafana.net/loki/api/v1/push
basic_auth:
username: // our user
password: // our api key
name: default
scrape_configs:
- job_name: kubernetes-pods-name
kubernetes_sd_configs:
- role: pod
pipeline_stages:
- docker: {}
relabel_configs:
- source_labels:
- __meta_kubernetes_pod_node_name
target_label: __host__
- action: labelmap
regex: __meta_kubernetes_pod_label_(.+)
- action: replace
replacement: $1
separator: /
source_labels:
- __meta_kubernetes_namespace
- __meta_kubernetes_pod_name
target_label: job
- action: replace
source_labels:
- __meta_kubernetes_namespace
target_label: namespace
- action: replace
source_labels:
- __meta_kubernetes_pod_name
target_label: pod
- action: replace
source_labels:
- __meta_kubernetes_pod_container_name
target_label: container
- replacement: /var/log/pods/*$1/*.log
separator: /
source_labels:
- __meta_kubernetes_pod_uid
- __meta_kubernetes_pod_container_name
target_label: __path__
positions_directory: /tmp/positions
And this is what we have in our cluster console,
level=info ts=2022-03-29T12:45:48.414635923Z caller=table.go:335 msg="uploading table index_19074"
level=info ts=2022-03-29T12:45:48.414665161Z caller=table.go:362 msg="finished uploading table index_19074"
level=info ts=2022-03-29T12:45:48.414693991Z caller=table.go:420 msg="cleaning up unwanted dbs from table index_19074"
level=info ts=2022-03-29T12:45:48.414743951Z caller=table.go:335 msg="uploading table index_19078"
level=info ts=2022-03-29T12:45:48.414778028Z caller=table.go:362 msg="finished uploading table index_19078"
level=info ts=2022-03-29T12:45:48.414851641Z caller=table.go:420 msg="cleaning up unwanted dbs from table index_19078"
level=info ts=2022-03-29T12:45:48.414950546Z caller=table.go:335 msg="uploading table index_19080"
level=info ts=2022-03-29T12:45:48.415018403Z caller=table.go:362 msg="finished uploading table index_19080"
level=info ts=2022-03-29T12:45:48.415096284Z caller=table.go:420 msg="cleaning up unwanted dbs from table index_19080"
level=info ts=2022-03-29T12:45:48.415179622Z caller=table.go:335 msg="uploading table index_19077"
level=info ts=2022-03-29T12:45:48.41523021Z caller=table.go:362 msg="finished uploading table index_19077"
level=info ts=2022-03-29T12:45:48.415269958Z caller=table.go:420 msg="cleaning up unwanted dbs from table index_19077"
level=info ts=2022-03-29T12:45:48.415341727Z caller=table.go:335 msg="uploading table index_19073"
level=info ts=2022-03-29T12:45:48.415386873Z caller=table.go:362 msg="finished uploading table index_19073"
level=info ts=2022-03-29T12:45:48.415432777Z caller=table.go:420 msg="cleaning up unwanted dbs from table index_19073"
level=info ts=2022-03-29T12:45:48.415533815Z caller=table.go:335 msg="uploading table index_19079"
level=info ts=2022-03-29T12:45:48.415587021Z caller=table.go:362 msg="finished uploading table index_19079"
level=info ts=2022-03-29T12:45:48.41564026Z caller=table.go:420 msg="cleaning up unwanted dbs from table index_19079"
level=info ts=2022-03-29T12:45:48.41572622Z caller=table.go:335 msg="uploading table index_19076"
level=info ts=2022-03-29T12:45:48.41577726Z caller=table.go:362 msg="finished uploading table index_19076"
level=info ts=2022-03-29T12:45:48.415824178Z caller=table.go:420 msg="cleaning up unwanted dbs from table index_19076"
Any idea what are we missing here?