StatsD exporter integration doesnt work using grafana agent and static config

Grafana Prometheus
1

Hello, community. Im spending tons of time to debug this issue. Common goal to collect statsd metrics from application running in ECS cluster and push them to the prometheus gateway. Previously I configured statsd exporter container and it work quiet well but still can’t resolve issue with embedded version of the statsd exporter. Please help.

  • What Grafana version and what operating system are you using?
    Grafana enterprise

  • What are you trying to achieve?
    Im trying to configure embedded statsD exporter integration for scraping metrics from external application.

  • How are you trying to achieve it?
    Im using grafana-agent docker container running in ECS cluster.

  • What happened?
    I configured grafana agent static config but getting an error :
    ts=2025-01-15T16:17:27.913092151Z caller=scrape.go:1400 level=debug agent=prometheus instance=563f0e0dce4515a206f67c7edb345611 component=“scrape manager” scrape_pool=integrations/statsd target=http://localhost:9102/metrics msg=“Scrape failed” err=“Get "http://localhost:9102/metrics\”: dial tcp 127.0.0.1:9102: connect: connection refused"`’
    I also see message from grafana agent that shows that agent getting response from metrics endpoint: ts=2025-01-15T16:16:40.489570715Z caller=logging.go:122 level=debug msg=“GET /integrations/statsd_exporter/metrics (200) 507.766µs”

  • What did you expect to happen?

  • Can you copy/paste the configuration(s) that you are having problems with?

  • server:
    log_level: debug

integrations:
statsd_exporter:
enabled: true
listen_udp: “:9125”
listen_tcp: “:9125”

metrics:
configs:
- name: integrations
scrape_configs:
- job_name: integrations/statsd
metrics_path: /metrics
static_configs:
- targets: [‘localhost:9102’]
relabel_configs:
- replacement: ‘statsd-metrics-embedded’
target_label: instance
remote_write:
- url: ‘${GEM_ENDPOINT}/api/v1/push’
basic_auth:
username: ${GEM_USER}
password: ${GEM_PASSWORD}
tls_config:
insecure_skip_verify: true

  • Did you receive any errors in the Grafana UI or in related logs? If so, please tell us exactly what they were.
  • Did you follow any online instructions? If so, what is the URL?
2

I think I got this.
In fact metrics are available on : localhost:80/integrations/statsd_exporter/metrics

But still can’t get why.