Series called 'value' in aggregated time series graph

Grafana Dashboards
1
  • What Grafana version and what operating system are you using?

10.0 on Rocky 9.6

  • What are you trying to achieve?

Time-series graphs - in this case of pod CPU usage

  • How are you trying to achieve it?

Successfully designing a promQL query to fetch container_cpu_usage_seconds_total and using rate and grouping by container

  • What happened?

This works fine but as well as a series for each grouped container, I am being returned a series whcih grafana is labelling ‘Value’ - in raw promQL GUI, this is the {} dataset. It seems to be some kind of summary but I don’t understand why it is being generated…

  • What did you expect to happen?

I do not expect this additional data series

  • Can you copy/paste the configuration(s) that you are having problems with?

sum(rate(container_cpu_usage_seconds_total[5m])) by (container) / sum(container_spec_cpu_quota/container_spec_cpu_period) by (container) * 100

  • Did you receive any errors in the Grafana UI or in related logs? If so, please tell us exactly what they were.

None

  • Did you follow any online instructions? If so, what is the URL?

Nothing particular - promQL docs

2

Hi, so when you get Value, it means that there was no such label in the result (label container was empty) - grafana doesn’t know what to add there, so it just puts “Value” so that the legend won’t be empty. With those metrics, you should remove empty containers (this stack response will tell you why).

3

This is really useful, thank you - it’s not an easy topic to search as ‘value’ is not a very selective keyword! I am now puzzled by why some containers are not labelled appropriately, but I’ll look at that thread you sent - the described fix of setting a {container!=””} works for the moment.

4

To sum it up, it comes to cgroups and how cadvisor treats them but I’m not too familiar with that topic though