Issues with PromQL displaying expected results on various dashboards




Grafana version: Not confirmed as of yet
OS: Linux: Red Hat Enterprise Linux release 8.10 (Ootpa)

Problem:
POMQL queries work fine and produce result set but the results are NOT displaying on dashboards. There are no errors found with any of the POMQL queries.

Details:

Prometheus:

Example of one of the queries for :Average Time Taken (Load → Curate)



SPINS QUERY

====================================== GRAFANA SPINS POMQL QUERY
( ((sum(increase(eis_loader_normalization_duration_seconds_sum{environment=“$environment”, source=“Spins”}[$interval])) / (sum(increase(eis_loader_normalization_duration_seconds_count{environment=“$environment”, source=“Spins”}[$interval]))>0)) or on() vector(0)) + ((sum(increase(eis_canonical_process_duration_seconds_sum{environment=“$environment”, source=“Spins”}[$interval])) / (sum(increase(eis_canonical_process_duration_seconds_count{environment=“$environment”, source=“Spins”}[$interval]))>0)) or on() vector(0)) + ((sum(increase(eis_neo_product_creation_duration_seconds_sum{environment=“$environment”, source=“Spins”}[$interval])) / (sum(increase(eis_neo_product_creation_duration_seconds_count{environment=“$environment”, source=“Spins”}[$interval]))>0)) or on() vector(0)) + ((sum(increase(eis_neo_product_curation_duration_seconds_sum{environment=“$environment”, source=“Spins”}[$interval])) / (sum(increase(eis_neo_product_curation_duration_seconds_count{environment=“$environment”, source=“Spins”}[$interval]))>0)) or on() vector(0)) ) OR on() vector(0)

POMQL CHECK RESULTS:

Note the query above are

  • What Grafana version and what operating system are you using?

  • What are you trying to achieve? Get POMQL results to display on dashboards.

  • How are you trying to achieve it? Running POMQL queries

  • What happened?: POMQL produces results but won’t display on dashboards.

  • What did you expect to happen?: to get both POMQL results and the same results displayed on dashboard.

  • Can you copy/paste the configuration(s) that you are having problems with? Done above..

  • Did you receive any errors in the Grafana UI or in related logs? If so, please tell us exactly what they were. None that I have seen.

  • Did you follow any online instructions? If so, what is the URL? - No but this board originally worked using PCF platform and we migrated it to GRAFAN with Kurbenetes and PROMETHEUS .