Creating a dashboard using ElasticSearch plus Elasticstash to collect Azure NSG Flow logs

  • What Grafana version and what operating system are you using?
    Grafana 7.0 in a Ubuntu 18.04LTS

  • What are you trying to achieve?
    Visualize Azure NSG Flow Logs

  • How are you trying to achieve it?
    NSG flow logs are enabled using Network Watcher and are stored in Azure blob storage. A Logstash plugin is used to connect and process flow logs from blob storage and send them to ElasticSearch. Once the flow logs are stored in ElasticSearch, they can be analyzed and visualized into customized dashboards in Grafana.

  • What happened?
    All the configurations on all 3 tools are done. Grafana is able to see the logs. However, I can’t get the right query to visualize in a Graph.

  • What did you expect to happen?
    As the procedure is showing, I was expecting to have the same output from the Graph dashboard.

  • Can you copy/paste the configuration(s) that you are having problems with?
    No problem at all. I think it is a lack of information regarding the query configuration to achieve the result that we are aimeing.

  • Did you receive any errors in the Grafana UI or in related logs? If so, please tell us exactly what they were.
    No

  • Did you follow any online instructions? If so, what is the URL?
    Manage NSG Flow Logs using Grafana - Azure Network Watcher | Microsoft Docs