Integration with Azure Metrics variables not getting full scope

Grafana Configuration
1

Hello everyone,

I am using Grafana v7.4.1 (07649d1313) and I am using the Azure Connector to access both metrics and Logs, I have used a service principal with system wide read permissions as described here.

I can query metrics and wirte KSL just fine. but my problem comes when defining variables.

Lets say I need to have a list of all the available resource groups.
I usually do something like this.

AzureMetrics
| distinct ResourceGroup

But this query does not work on the variable pane. In fact I can only see AzureAnalytics and Usage there:

Screenshot from 2021-02-17 12-22-33
Screenshot from 2021-02-17 12-22-331073×609 32.3 KB

Is is something I am doing wrong ? Maybe the scope needs to specified ?
Again, if I build a panel on the dashboard this does not happen.

2

Since no one replied here. I will reply the solution I have worked out in order to have variables with azure metrics.
I enabled the sqlite plugin.
Using this script:

#!/usr/bin/python

from azure.identity import ClientSecretCredential
from azure.mgmt.resource import ResourceManagementClient
from datetime import datetime
import os
import sqlite3
import time

""" Gets Azure resource groups and virtaul machines
 I assume the following variables exist
 AZURE_TENANT_ID: with your Azure Active Directory tenant id or domain
 AZURE_CLIENT_ID: with your Azure Active Directory Application Client ID
 AZURE_CLIENT_SECRET: with your Azure Active Directory Application Secret
 AZURE_SUBSCRIPTION_ID: with your Azure Subscription Id
 Optionally:
 DATA_DB_PATH: The path for the sqlite database to be in otherwise, if not
 set it  be data.db on the current directory
"""


db_path = "data.db"
if os.environ.get("DATA_DB_PATH"):
    db_path = os.environ.get("DATA_DB_PATH")
    if not os.path.exists(os.path.dirname(db_path)):
        print("Creating database basedir: {dir}".format(dir = os.path.dirname(db_path)))
        os.mkdir(os.path.dirname(db_path))


conn = sqlite3.connect(db_path)
conn.execute("""
    CREATE TABLE IF NOT EXISTS virtual_machines 
        (id INTEGER PRIMARY KEY AUTOINCREMENT, resource_group VARCHAR(50), name TEXT);""")
conn.execute("""CREATE UNIQUE INDEX IF NOT EXISTS idx_virtual_machines_name
        ON virtual_machines (name);""")


def fetch_data():

    subscription_id = os.environ.get("AZURE_SUBSCRIPTION_ID")
    client_id = os.environ.get("AZURE_CLIENT_ID")
    client_secret = os.environ.get("AZURE_CLIENT_SECRET")
    tenant_id = os.environ.get("AZURE_TENANT_ID")

    credentials = ClientSecretCredential(
        client_id = client_id,
        client_secret = client_secret,
        tenant_id = tenant_id
    )

    client = ResourceManagementClient(credentials, subscription_id)

    for res_group in client.resource_groups.list():
        print("Listing resources for {n}".format(n = res_group.name))
        for res in client.resources.list_by_resource_group(res_group.name):
            if res.type == "Microsoft.Compute/virtualMachines":
                conn.execute("INSERT OR REPLACE INTO virtual_machines(resource_group, name) VALUES(?,?)", [res_group.name, res.name])

    conn.commit()

interrupt = False
while not interrupt:
    try:
        fetch_data()
        if not interrupt:
            print("Resting for 10 minutes")
            time.sleep(600)
    except(KeyboardInterrupt, SystemExit):
        print("Received Keyboard Interrupt or system existing, exiting")
        interrupt=True

conn.close()

And then you can query the information from the database.
Here is a full example: Collect Azure Resource List and Virtual Machines into SQLite · GitHub

I hope this is useful for anyone. Since it makes no sense the lack of ability to not query information from withing the variables on some cases.

1 Like