Hi; I’ve deployed Tempo to a Kubernetes cluster, but it doesn’t seem to be persisting traces. I have the following in my tempo-config
ConfigMap
:
storage:
trace:
backend: gcs
gcs:
bucket_name: commure-grafana
prefix: traces
tempo_cluster_seed.json
is the only thing that has been written to the bucket.
I can ingest a trace, and it shows up in Grafana, but it is lost if I restart the tempo-ingester-*
pods (after which it no longer shows in Grafana), and there’s no data AFAICT being written to GCS.
The ingester pods aren’t emitting any errors, AFAICT.