I have setup Grafana Tempo on aks and I have exposed distributor service as loadbalancer and using azure blob storage .
I have tried to send the trace data to tempo but I didn’t see any logs in distributor pod.
config:
traces:
otlp:
http:
enabled: true
grpc:
enabled: true
ingester:
max_block_duration: 5m
memcached:
enabled: false
distributor:
receivers:
otlp:
protocols:
http:
grpc:
service:
type: LoadBalancer
config:
log_received_spans:
enabled: true
filter_by_status_error: true
include_all_attributes: true
Trace data is getting published with following job but not with dotnet 8 service
Job:
apiVersion: batch/v1
kind: Job
metadata:
name: generate-traces
spec:
template:
spec:
restartPolicy: Never
containers:
- name: tracegen
image: Package xk6-client-tracing · GitHub
env:
- name: ENDPOINT
value: tempo-distributor.observability.svc.cluster.local:4317
I’m clueless about the issue as I don’t see any logs or errors
Dotnet code:
tracing.AddOtlpExporter(otlpOptions =>
{
otlpOptions.Endpoint = new Uri(“http://loadbalancerip:4317”);
});
Note: I have tried using console exporter…able to see the traces there as expected
I’m not using any otelcollector or grafana agent…I’m trying to add telemetry data to tempo db directly from dotnet8 service using grpc endpoint