Can Agents Add Themselves?

Grafana Prometheus
1

We have a use case that requires getting logs from different and previously unknown IPs. AFAIK node_exporter runs as a service and Prometheus server needs to connect to it. This requires manual configuration for every IP. Is there any way to automate this?

Our current ideas are:
- An API on the server the new machines can request to. The API will add the new IPs to Prometheus.
- We can alter the images the new machines boot with. Maybe a script that connects the server with ssh and adds the IP?

Does Grafana or Prometheus supports this kind of use case?

2

Have a look at promsd on GitHub, provide an api to add and remove node from Prometheus Jobs.

3

There’s another configuration method, dns_sd_config, which will automatically detect nodes in a DNS domain: