Hello Grafana Community,
I am encountering an issue with the dropdown list for node selection in my Grafana dashboard and would appreciate any insights or suggestions you might have.
Setup:
- Grafana version: 10.4.1
- Datasource: Prometheus
- To get the nodes: I am querying ‘u_name_info’ from one of the metrics fetching u_name from the system.
- Our setup includes multiple nodes, and we use Grafana to monitor the metrics.
- At the top of our Grafana dashboard, we have a dropdown list to select the node for which we want to view the metrics.
Issue:
- The dropdown list does not consistently display all nodes. The list appears to be dynamic and changes with each refresh.
- Upon every refresh, the nodes displayed in the dropdown list change. If a node is not displayed, typing the node’s name still allows us to select it and view its data.
- The list seems to be populated based on the data present within the selected time window. For example:
- If the time window is set to the last 5 seconds, the list shows nodes with data from that period (e.g., 10 nodes).
- If the time window is set to one day or more, the list shows more nodes (e.g., 25/26 nodes).
- Our deployment consists of around 40+ nodes. However, even with a broader time window, we observe only 25/26 nodes.
- Data for the missing nodes is present, as we can see it by manually typing the node names in the dropdown.
- We have verified that all nodes are listed in the json data file.
Observations:
- The issue seems related to how Grafana dynamically calculates the dropdown list based on the available data within the selected time window.
- On multiple refreshes, a significant number of nodes eventually appear in the dropdown list.
I am seeking advice on how to ensure that all nodes are consistently displayed in the dropdown list. Has anyone encountered a similar issue, or is there a known solution or workaround for this?
Thanks in advance for your assistance.