Hello Team: I am trying to setup Tempo, in order to get the traces , in order to export the traces , i am using OTLP. i have configured it on the EKS cluster and reaching Tempo via ingress FQDN. I am not able to get traces in Tempo , i am stuck in this for a long time : Shairing logs from tempo and OTLP querier.
level=error ts=2024-05-15T11:04:19.675442067Z caller=frontend_processor.go:63 msg="error contacting frontend" address=100.64.152.160:9095 err="rpc error: code = Canceled desc = context canceled"
level=error ts=2024-05-15T11:04:19.675461397Z caller=frontend_processor.go:63 msg="error contacting frontend" address=100.64.152.160:9095 err="rpc error: code = Canceled desc = context canceled"
level=error ts=2024-05-15T11:04:19.675458002Z caller=frontend_processor.go:63 msg="error contacting frontend" address=100.64.152.160:9095 err="rpc error: code = Canceled desc = context canceled"
level=error ts=2024-05-15T11:04:19.67543526Z caller=frontend_processor.go:63 msg="error contacting frontend" address=100.64.152.160:9095 err="rpc error: code = Canceled desc = context canceled"
level=error ts=2024-05-15T11:04:19.675488704Z caller=frontend_processor.go:63 msg="error contacting frontend" address=100.64.152.160:9095 err="rpc error: code = Canceled desc = context canceled"
level=error ts=2024-05-15T11:04:19.675485237Z caller=frontend_processor.go:63 msg="error contacting frontend" address=100.64.152.160:9095 err="rpc error: code = Canceled desc = context canceled"
level=error ts=2024-05-15T11:04:19.675485193Z caller=frontend_processor.go:63 msg="error contacting frontend" address=100.64.152.160:9095 err="rpc error: code = Canceled desc = context canceled"
level=error ts=2024-05-15T11:04:19.675498114Z caller=frontend_processor.go:63 msg="error contacting frontend" address=100.64.152.160:9095 err="rpc error: code = Canceled desc = context canceled"
level=error ts=2024-05-15T11:04:19.675512084Z caller=frontend_processor.go:63 msg="error contacting frontend" address=100.64.152.160:9095 err="rpc error: code = Canceled desc = context canceled"
level=error ts=2024-05-15T11:04:19.675511882Z caller=frontend_processor.go:63 msg="error contacting frontend" address=100.64.152.160:9095 err="rpc error: code = Canceled desc = context canceled"
OTLP logs
2024-05-15T08:01:00.728Z info exporter@v0.96.0/exporter.go:275 Development component. May change in the future. {"kind": "exporter", "data_type": "traces", "name": "debug"}
2024-05-15T08:01:00.729Z info memorylimiter/memorylimiter.go:160 Using percentage memory limiter {"kind": "processor", "name": "memory_limiter", "pipeline": "traces", "total_memory_mib": 62825, "limit_percentage": 80, "spike_limit_percentage": 25}
2024-05-15T08:01:00.729Z info memorylimiter/memorylimiter.go:77 Memory limiter configured {"kind": "processor", "name": "memory_limiter", "pipeline": "traces", "limit_mib": 50260, "spike_limit_mib": 15706, "check_interval": 5}
2024-05-15T08:01:00.751Z info otlpreceiver@v0.96.0/otlp.go:102 Starting GRPC server {"kind": "receiver", "name": "otlp", "data_type": "traces", "endpoint": "0.0.0.0:4317"}
2024-05-15T08:01:00.751Z info otlpreceiver@v0.96.0/otlp.go:152 Starting HTTP server {"kind": "receiver", "name": "otlp", "data_type": "traces", "endpoint": "0.0.0.0:4318"}
can someone please help here , i am stuck in this issue for long!