Hi all,
I have tempo distributed deployed on on-premises. My system is Debian GNU/Linux 12 (bookworm).
Here’s my config:
server:
http_listen_port: 3200
grpc_listen_port: 9095
distributor:
ring:
kvstore:
store: memberlist
ingester:
lifecycler:
join_after: 0s
ring:
kvstore:
store: memberlist
replication_factor: 3
storage:
trace:
backend: local
local:
path: /var/lib/tempo/traces
wal:
path: /tmp/tempo/wal
memberlist:
abort_if_cluster_join_fails: false
bind_port: 7946
join_members:
- 10.20.26.94:7946
- 10.20.26.95:7946
- 10.20.26.96:7946
# systemctl status tempo.service
● tempo.service - Tempo service
Loaded: loaded (/etc/systemd/system/tempo.service; enabled; preset: enabled)
Active: active (running) since Tue 2025-09-16 16:59:16 WIB; 13min ago
Main PID: 18836 (tempo)
Tasks: 19 (limit: 19131)
Memory: 26.9M
CPU: 3.288s
CGroup: /system.slice/tempo.service
└─18836 /usr/bin/tempo -config.file /etc/tempo/config.yml
Sep 16 16:59:17 svr-026094 tempo[18836]: level=info ts=2025-09-16T09:59:17.068523178Z caller=lifecycler.go:677 msg="not loading tokens from file, tokens file path is empty"
Sep 16 16:59:17 svr-026094 tempo[18836]: level=info ts=2025-09-16T09:59:17.068583472Z caller=lifecycler.go:704 msg="instance not found in ring, adding with no tokens" ring=ingester
Sep 16 16:59:17 svr-026094 tempo[18836]: level=info ts=2025-09-16T09:59:17.068685833Z caller=lifecycler.go:546 msg="auto-joining cluster after timeout" ring=ingester
Sep 16 16:59:17 svr-026094 tempo[18836]: level=info ts=2025-09-16T09:59:17.069154915Z caller=worker.go:250 msg="total worker concurrency updated" totalConcurrency=20
Sep 16 16:59:17 svr-026094 tempo[18836]: ts=2025-09-16T09:59:17Z level=info msg="Starting HTTP server for Jaeger Thrift" component=tempo endpoint=localhost:14268
Sep 16 16:59:17 svr-026094 tempo[18836]: ts=2025-09-16T09:59:17Z level=info msg="Starting gRPC server for Jaeger Protobuf" component=tempo endpoint=localhost:14250
Sep 16 16:59:17 svr-026094 tempo[18836]: ts=2025-09-16T09:59:17Z level=info msg="Starting GRPC server" component=tempo endpoint=localhost:4317
Sep 16 16:59:17 svr-026094 tempo[18836]: level=info ts=2025-09-16T09:59:17.0820831Z caller=app.go:211 msg="Tempo started"
Sep 16 17:04:17 svr-026094 tempo[18836]: level=info ts=2025-09-16T10:04:17.069713903Z caller=poller.go:251 msg="blocklist poll complete" seconds=0.000162102
Sep 16 17:09:17 svr-026094 tempo[18836]: level=info ts=2025-09-16T10:09:17.069619295Z caller=poller.go:251 msg="blocklist poll complete" seconds=0.000133363
I have no idea that why port 7946 is not enabled.
# netstat -tuln
Active Internet connections (only servers)
Proto Recv-Q Send-Q Local Address Foreign Address State
tcp 0 0 0.0.0.0:3200 0.0.0.0:* LISTEN
tcp 0 0 0.0.0.0:1932 0.0.0.0:* LISTEN
tcp 0 0 0.0.0.0:9095 0.0.0.0:* LISTEN
tcp 0 0 127.0.0.1:14250 0.0.0.0:* LISTEN
tcp 0 0 127.0.0.1:14268 0.0.0.0:* LISTEN
tcp 0 0 127.0.0.1:4317 0.0.0.0:* LISTEN
udp 0 0 0.0.0.0:59206 0.0.0.0:*
udp 0 0 0.0.0.0:5353 0.0.0.0:*
Can someone please guide what might be wrong in the config?