Google Cloud Monitoring plugin unable to parse metric labels?

Grafana
,
1

  • What Grafana version and what operating system are you using?
    Grafana 8.4.3 - Firefox - WIndows 10

  • What are you trying to achieve?
    Pull request counts from the apigee service in Google Cloud Monitoring.

  • How are you trying to achieve it?
    Using the Google Cloud Monitoring plugin with a service account that has the equivalent of the monitoring.viewer role. I created a query to pull request counts under the MQL editor in a new dashboard:

fetch apigee.googleapis.com/ProxyV2 | metric ‘apigee.googleapis.com/proxyv2/request_count’ | group_by [resource.proxy_name]

I also tried the builder and variable tools to see if I could get the labels to appear somewhere.

  • What happened?

I got the data I expected back, BUT all time series’ are labeled as “value_request_count_aggregate” instead of their label. Checking in the network inspector in firefox, it does appear that my client is receiving those label names in the response from Grafana.

The “Builder” for Google Cloud Monitoring consistently returns nothing no matter what fields are selected. The only labels that are shown in the “Group by” drop down are metadata labels (that I believe live at the project level).

Trying to create a variable that queries label values also yielded a similar result: Only metadata labels were shown in the drop down.

  • What did you expect to happen?

I would expect the Grafana client to be able to parse the label names returned in the response from the Grafana server so I can show data that makes sense to our users.

  • Can you copy/paste the configuration(s) that you are having problems with?

See query above. I will post images if I can.

  • Did you receive any errors in the Grafana UI or in related logs? If so, please tell us exactly what they were.

None

  • Did you follow any online instructions? If so, what is the URL?

Yes, but I cannot post it as I am a new user apparently.

2

Here’s some images of the issue:

I get data, but Grafana defaults to an unhelpful label name.

image
image1461×907 238 KB

The label names are returned in the response:

image
image1278×300 19.7 KB

Only metadata labels are available from drop downs:
(Can’t post this apparently)

Also the drop down window always goes off screen, but only Template Variables and Metadata System Labels are available here.

I would love to use an alias to bypass this error, but I’m not sure if I can even access the correct label name using an alias. There doesn’t seem to be a good way to see all variables that I can use in an alias anywhere.

3

Been working on this a bit, and found I can use an “Alias by” like {{resource.label.proxy_name}} to get the legend to appear correctly, BUT I can’t seem to force that in any drop downs, meaning creating variables on label names is not possible and a huge headache for dashboard design.