I just started my learning path with Grafana and its stack and for 3-4 days I’ve been unable to resolve the issue with my ingestor. I cannot make it see/join the ring. My network looks like this:
I have local docker network with 1 container each of : grafana, alloy, tempo, mimir, loki, pyroscope
2 containers of same web application that will generate all the metrics/logs/etc.
The error I get in my tempo logs in my docker container is
caller=rate_limited_logger.go:38 msg=“Pusher failed to consume trace data” err=“DoBatch: InstancesCount <=0”
I would highly appreciate some help and advices because I’m going insane at this point.
my tempo.yaml is
target: all
server:
http_listen_port:3200
distributor:
receivers:
otlp:
protocols:
grpc:
endpoint: "0.0.0.0:4317"
http:
endpoint: "0.0.0.0:4318"
log_received_spans:
enabled: true
ring:
instance_addr:127.0.0.1
kvstore:
store:inmemory
ingester:
lifecycler:
address: 127.0.0.1
ring:
kvstore:
store: inmemory
replication_factor: 1
query_frontend:
search:
duration_slo: 5s
storage:
trace:
backend: local
wal:
path: /var/tempo/wal
local:
path: /var/tempo/blocks
stream_over_http_enabled: true