Remotecfg not working with prometheus

Grafana Alloy
1

Hi, using remotecfg (which I’m receiving correctly from the server).

image
image1403×773 69.4 KB

I’m having a problem:

Loki pipelines are working correctly.
Prometheus pipelines (Blackbox and Windows) aren’t working.

image
image1272×404 52 KB

image
image1267×444 29.6 KB

image
image1547×718 107 KB

image
image1565×733 79.2 KB

This is my configuration:

// -----------------------CONFIGURACION DE ALLOY--------------------------
remotecfg {
  url = "http://server.local:8888"
  id = constants.hostname + ".XXXX.local"
  poll_frequency = "2m"
  attributes = {
    "grupo" = "XXXX",
    "tenant" = "local",
    "os_system" = "Windows",
    }
}

//Bloque común de Logs de Alloy
logging {
        level = "debug" // or "info", "warn", "error", "debug"
        format = "logfmt" // or "json"  
}

//Bloque de pruebas en vivo
livedebugging {
  enabled = true
}

Logs:

Information,6/29/2025 6:49:17 PM,Alloy,1,None,ts=2025-06-29T22:49:17.9863871Z level=debug msg=QueueManager.updateShardsLoop component_path=/remotecfg component_id=prometheus.remote_write.prometheus_xxx_01 subcomponent=rw remote_name=053417 url=http://server.xxx.local:9090/api/v1/write lowerBound=0.7 desiredShards=0.00017308300095964242 upperBound=1.3
Information,6/29/2025 6:49:17 PM,Alloy,1,None,ts=2025-06-29T22:49:17.9863871Z level=debug msg=QueueManager.calculateDesiredShards component_path=/remotecfg component_id=prometheus.remote_write.prometheus_xxx_01 subcomponent=rw remote_name=053417 url=http://server.xxx.local:9090/api/v1/write dataInRate=0.5 dataOutRate=0.5 dataKeptRatio=1 dataPendingRate=0 dataPending=6 dataOutDuration=0.00010817687559977651 timePerSample=0.00021635375119955302 desiredShards=0.00017308300095964242 highestSent=1.751237344e+09 highestRecv=1.751237356e+09
Information,6/29/2025 6:49:16 PM,Alloy,1,None,"ts=2025-06-29T22:49:16.0981239Z level=debug msg=""Scrape failed"" component_path=/remotecfg component_id=prometheus.scrape.blackbox_http scrape_pool=remotecfg/prometheus.scrape.blackbox_http target=""http://alloy.internal:12345/api/v0/component/remotecfg/prometheus.exporter.blackbox.http_targets/metrics?module=http_2xx&target=https%3A%2F%2Fexample.com"" err=""server returned HTTP status 400 Bad Request""
Information,6/29/2025 6:49:07 PM,Alloy,1,None,ts=2025-06-29T22:49:07.9846799Z level=debug msg=QueueManager.updateShardsLoop component_path=/remotecfg component_id=prometheus.remote_write.prometheus_xxx_01 subcomponent=rw remote_name=053417 url=http://server.xxx.local:9090/api/v1/write lowerBound=0.7 desiredShards=0.00015415903229960888 upperBound=1.3
Information,6/29/2025 6:49:07 PM,Alloy,1,None,ts=2025-06-29T22:49:07.9846799Z level=debug msg=QueueManager.calculateDesiredShards component_path=/remotecfg component_id=prometheus.remote_write.prometheus_xxx_01 subcomponent=rw remote_name=053417 url=http://server.xxx.local:9090/api/v1/write dataInRate=0.5 dataOutRate=0.5 dataKeptRatio=1 dataPendingRate=0 dataPending=4 dataOutDuration=0.00011011359449972063 timePerSample=0.00022022718899944126 desiredShards=0.00015415903229960888 highestSent=1.751237336e+09 highestRecv=1.751237344e+09
Information,6/29/2025 6:49:04 PM,Alloy,1,None,"ts=2025-06-29T22:49:04.7236304Z level=debug msg=""Scrape failed"" component_path=/remotecfg component_id=prometheus.scrape.scrape_windows_exporter scrape_pool=windows_servers target=http://alloy.internal:12345/api/v0/component/remotecfg/prometheus.exporter.windows.windows_exporter_config/metrics err=""server returned HTTP status 400 Bad Request""
Information,6/29/2025 6:48:57 PM,Alloy,1,None,ts=2025-06-29T22:48:57.9853539Z level=debug msg=QueueManager.updateShardsLoop component_path=/remotecfg component_id=prometheus.remote_write.prometheus_xxx_01 subcomponent=rw remote_name=053417 url=http://server.xxx.local:9090/api/v1/write lowerBound=0.7 desiredShards=0.00016887298968697618 upperBound=1.3
Information,6/29/2025 6:48:57 PM,Alloy,1,None,ts=2025-06-29T22:48:57.9853539Z level=debug msg=QueueManager.calculateDesiredShards component_path=/remotecfg component_id=prometheus.remote_write.prometheus_xxx_01 subcomponent=rw remote_name=053417 url=http://server.xxx.local:9090/api/v1/write dataInRate=0.5 dataOutRate=0.5 dataKeptRatio=1 dataPendingRate=0 dataPending=5 dataOutDuration=0.00011258199312465079 timePerSample=0.00022516398624930159 desiredShards=0.00016887298968697618 highestSent=1.751237326e+09 highestRecv=1.751237336e+09
Information,6/29/2025 6:48:56 PM,Alloy,1,None,"ts=2025-06-29T22:48:56.3443954Z level=debug msg=""Scrape failed"" component_path=/remotecfg component_id=prometheus.scrape.blackbox_http scrape_pool=remotecfg/prometheus.scrape.blackbox_http target=""http://alloy.internal:12345/api/v0/component/remotecfg/prometheus.exporter.blackbox.http_targets/metrics?module=http_2xx&target=https%3A%2F%2Fgrafana.com"" err=""server returned HTTP status 400 Bad Request""
Information,6/29/2025 6:48:48 PM,Alloy,1,None,"ts=2025-06-29T22:48:48.1052516Z level=debug msg=""runShard timer ticked, sending buffered data"" component_path=/remotecfg component_id=prometheus.remote_write.prometheus_xxx_01 subcomponent=rw remote_name=053417 url=http://server.xxx.local:9090/api/v1/write samples=5 exemplars=0 shard=0 histograms=0
Information,6/29/2025 6:48:47 PM,Alloy,1,None,ts=2025-06-29T22:48:47.9832302Z level=debug msg=QueueManager.updateShardsLoop component_path=/remotecfg component_id=prometheus.remote_write.prometheus_xxx_01 subcomponent=rw remote_name=053417 url=http://server.xxx.local:9090/api/v1/write lowerBound=0.7 desiredShards=0.0001853279862493016 upperBound=1.3
Information,6/29/2025 6:48:47 PM,Alloy,1,None,ts=2025-06-29T22:48:47.9832302Z level=debug msg=QueueManager.calculateDesiredShards component_path=/remotecfg component_id=prometheus.remote_write.prometheus_xxx_01 subcomponent=rw remote_name=053417 url=http://server.xxx.local:9090/api/v1/write dataInRate=0.5 dataOutRate=0.5 dataKeptRatio=1 dataPendingRate=0 dataPending=6 dataOutDuration=0.00011582999140581349 timePerSample=0.00023165998281162698 desiredShards=0.0001853279862493016 highestSent=1.751237314e+09 highestRecv=1.751237326e+09
Information,6/29/2025 6:48:46 PM,Alloy,1,None,"ts=2025-06-29T22:48:46.0960385Z level=debug msg=""Scrape failed"" component_path=/remotecfg component_id=prometheus.scrape.blackbox_http scrape_pool=remotecfg/prometheus.scrape.blackbox_http target=""http://alloy.internal:12345/api/v0/component/remotecfg/prometheus.exporter.blackbox.http_targets/metrics?module=http_2xx&target=https%3A%2F%2Fexample.com"" err=""server returned HTTP status 400 Bad Request""
Information,6/29/2025 6:48:37 PM,Alloy,1,None,ts=2025-06-29T22:48:37.982189Z level=debug msg=QueueManager.updateShardsLoop component_path=/remotecfg component_id=prometheus.remote_write.prometheus_xxx_01 subcomponent=rw remote_name=053417 url=http://server.xxx.local:9090/api/v1/write lowerBound=0.7 desiredShards=0.0001679089849601736 upperBound=1.3
Information,6/29/2025 6:48:37 PM,Alloy,1,None,ts=2025-06-29T22:48:37.982189Z level=debug msg=QueueManager.calculateDesiredShards component_path=/remotecfg component_id=prometheus.remote_write.prometheus_xxx_01 subcomponent=rw remote_name=053417 url=http://server.xxx.local:9090/api/v1/write dataInRate=0.5 dataOutRate=0.5 dataKeptRatio=1 dataPendingRate=0 dataPending=4 dataOutDuration=0.00011993498925726686 timePerSample=0.00023986997851453373 desiredShards=0.0001679089849601736 highestSent=1.751237306e+09 highestRecv=1.751237314e+09
Information,6/29/2025 6:48:34 PM,Alloy,1,None,"ts=2025-06-29T22:48:34.7213284Z level=debug msg=""Scrape failed"" component_path=/remotecfg component_id=prometheus.scrape.scrape_windows_exporter scrape_pool=windows_servers target=http://alloy.internal:12345/api/v0/component/remotecfg/prometheus.exporter.windows.windows_exporter_config/metrics err=""server returned HTTP status 400 Bad Request""
Information,6/29/2025 6:48:27 PM,Alloy,1,None,ts=2025-06-29T22:48:27.9814967Z level=debug msg=QueueManager.updateShardsLoop component_path=/remotecfg component_id=prometheus.remote_write.prometheus_xxx_01 subcomponent=rw remote_name=053417 url=http://server.xxx.local:9090/api/v1/write lowerBound=0.7 desiredShards=0.00018740060485737534 upperBound=1.3
Information,6/29/2025 6:48:27 PM,Alloy,1,None,ts=2025-06-29T22:48:27.9814967Z level=debug msg=QueueManager.calculateDesiredShards component_path=/remotecfg component_id=prometheus.remote_write.prometheus_xxx_01 subcomponent=rw remote_name=053417 url=http://server.xxx.local:9090/api/v1/write dataInRate=0.5 dataOutRate=0.5 dataKeptRatio=1 dataPendingRate=0 dataPending=5 dataOutDuration=0.00012493373657158357 timePerSample=0.00024986747314316714 desiredShards=0.00018740060485737534 highestSent=1.751237296e+09 highestRecv=1.751237306e+09
Information,6/29/2025 6:48:26 PM,Alloy,1,None,"ts=2025-06-29T22:48:26.3421178Z level=debug msg=""Scrape failed"" component_path=/remotecfg component_id=prometheus.scrape.blackbox_http scrape_pool=remotecfg/prometheus.scrape.blackbox_http target=""http://alloy.internal:12345/api/v0/component/remotecfg/prometheus.exporter.blackbox.http_targets/metrics?module=http_2xx&target=https%3A%2F%2Fgrafana.com"" err=""server returned HTTP status 400 Bad Request""
2

I finally solved it, thanks to everyone who commented (sarcasm).

I found the solution, and it wasn’t in the official documentation.