Grafana Dashboard Templating Error Updating Options Network Error Bad Request ?!

Grafana Dashboards
1

  • What Grafana version and what operating system are you using?
    RHEL 8.6
    Grafana 9.0.4

  • What are you trying to achieve?
    Dashboard Visualization from InfluxDB for vSphere environment

  • How are you trying to achieve it?
    Using Dashboard ID 8159

  • What happened?
    Showing various Templating Errors

  • What did you expect to happen?
    Work

  • Can you copy/paste the configuration(s) that you are having problems with?
    *[root@d-ifdb-nm ~]# systemctl status grafana-server.service *
    ● grafana-server.service - Grafana instance

  • Loaded: loaded (/usr/lib/systemd/system/grafana-server.service; enabled; vendor preset: disabled)*

  • Active: active (running) since Sun 2022-07-24 09:17:47 IST; 12min ago*

  • Docs: http://docs.grafana.org*

  • Main PID: 1447 (grafana-server)*

  • Tasks: 13 (limit: 11233)*

  • Memory: 68.2M*

  • CGroup: /system.slice/grafana-server.service*

  •       └─1447 /usr/sbin/grafana-server --config=/etc/grafana/grafana.ini --pidfile=/var/run/grafana/grafana-server.pid --packaging=rpm cfg:default.paths.logs=/var/log/grafana cfg:default.paths.data=/var/lib>*

Jul 24 09:17:47 d-ifdb-nm.vlab.lab grafana-server[1447]: logger=query_data t=2022-07-24T09:17:47.094764699+01:00 level=info msg=“Query Service initialization”
Jul 24 09:17:47 d-ifdb-nm.vlab.lab grafana-server[1447]: logger=live.push_http t=2022-07-24T09:17:47.125947577+01:00 level=info msg=“Live Push Gateway initialization”
Jul 24 09:17:47 d-ifdb-nm.vlab.lab grafana-server[1447]: logger=infra.usagestats.collector t=2022-07-24T09:17:47.420291147+01:00 level=info msg=“registering usage stat providers” usageStatsProvidersLen=2
Jul 24 09:17:47 d-ifdb-nm.vlab.lab grafana-server[1447]: logger=server t=2022-07-24T09:17:47.420554754+01:00 level=info msg=“Writing PID file” path=/var/run/grafana/grafana-server.pid pid=1447
Jul 24 09:17:47 d-ifdb-nm.vlab.lab grafana-server[1447]: logger=grafanaStorageLogger t=2022-07-24T09:17:47.426523476+01:00 level=info msg=“storage starting”
Jul 24 09:17:47 d-ifdb-nm.vlab.lab grafana-server[1447]: logger=report t=2022-07-24T09:17:47.426586397+01:00 level=warn msg="Scheduling and sending of reports disabled, SMTP is not configured and enabled. Confi>
Jul 24 09:17:47 d-ifdb-nm.vlab.lab systemd[1]: Started Grafana instance.
Jul 24 09:17:47 d-ifdb-nm.vlab.lab grafana-server[1447]: logger=ngalert t=2022-07-24T09:17:47.437136817+01:00 level=info msg=“warming cache for startup”
Jul 24 09:17:47 d-ifdb-nm.vlab.lab grafana-server[1447]: logger=http.server t=2022-07-24T09:17:47.445370981+01:00 level=info msg=“HTTP Server Listen” address=[::]:3000 protocol=http subUrl= socket=
Jul 24 09:17:47 d-ifdb-nm.vlab.lab grafana-server[1447]: logger=ngalert.multiorg.alertmanager t=2022-07-24T09:17:47.497453664+01:00 level=info msg=“starting MultiOrg Alertmanager”

*[root@d-ifdb-nm ~]# systemctl status influxd.service *
● influxdb.service - InfluxDB is an open-source, distributed, time series database

  • Loaded: loaded (/usr/lib/systemd/system/influxdb.service; enabled; vendor preset: disabled)*
  • Active: active (running) since Sun 2022-07-24 09:17:47 IST; 12min ago*
  • Docs: https://docs.influxdata.com/influxdb/*
  • Process: 1445 ExecStart=/usr/lib/influxdb/scripts/influxd-systemd-start.sh (code=exited, status=0/SUCCESS)*
  • Main PID: 1453 (influxd)*
  • Tasks: 12 (limit: 11233)*
  • Memory: 41.4M*
  • CGroup: /system.slice/influxdb.service*
  •       └─1453 /usr/bin/influxd*

Jul 24 09:17:46 d-ifdb-nm.vlab.lab influxd-systemd-start.sh[1453]: ts=2022-07-24T08:17:46.757511Z lvl=info msg=“Starting precreation service” log_id=0bspO9eW000 service=shard-precreation check_interval=10m adva>
Jul 24 09:17:46 d-ifdb-nm.vlab.lab influxd-systemd-start.sh[1453]: ts=2022-07-24T08:17:46.760815Z lvl=info msg=“Starting query controller” log_id=0bspO9eW000 service=storage-reads concurrency_quota=1024 initial>
Jul 24 09:17:46 d-ifdb-nm.vlab.lab influxd-systemd-start.sh[1453]: ts=2022-07-24T08:17:46.763878Z lvl=info msg=“Configuring InfluxQL statement executor (zeros indicate unlimited).” log_id=0bspO9eW000 max_select>
Jul 24 09:17:46 d-ifdb-nm.vlab.lab influxd-systemd-start.sh[1453]: ts=2022-07-24T08:17:46.774358Z lvl=info msg=Listening log_id=0bspO9eW000 service=tcp-listener transport=http addr=:8086 port=8086
Jul 24 09:17:46 d-ifdb-nm.vlab.lab influxd-systemd-start.sh[1453]: ts=2022-07-24T08:17:46.774417Z lvl=info msg=Starting log_id=0bspO9eW000 service=telemetry interval=8h
Jul 24 09:17:47 d-ifdb-nm.vlab.lab systemd[1]: Started InfluxDB is an open-source, distributed, time series database.
Jul 24 09:17:47 d-ifdb-nm.vlab.lab influxd-systemd-start.sh[1445]: InfluxDB started
Jul 24 09:27:46 d-ifdb-nm.vlab.lab influxd-systemd-start.sh[1453]: ts=2022-07-24T08:27:46.759687Z lvl=info msg=“Cache snapshot (start)” log_id=0bspO9eW000 service=storage-engine engine=tsm1 op_name=tsm1_cache_s>
Jul 24 09:27:46 d-ifdb-nm.vlab.lab influxd-systemd-start.sh[1453]: ts=2022-07-24T08:27:46.765779Z lvl=info msg=“Snapshot for path written” log_id=0bspO9eW000 service=storage-engine engine=tsm1 op_name=tsm1_cach>
Jul 24 09:27:46 d-ifdb-nm.vlab.lab influxd-systemd-start.sh[1453]: ts=2022-07-24T08:27:46.765847Z lvl=info msg=“Cache snapshot (end)” log_id=0bspO9eW000 service=storage-engine engine=tsm1 op_name=tsm1_cache_sna>

*[root@d-ifdb-nm ~]# systemctl status telegraf.service *
● telegraf.service - The plugin-driven server agent for reporting metrics into InfluxDB

  • Loaded: loaded (/usr/lib/systemd/system/telegraf.service; enabled; vendor preset: disabled)*
  • Active: failed (Result: exit-code) since Sun 2022-07-24 09:18:55 IST; 11min ago*
  • Docs: https://github.com/influxdata/telegraf*
  • Process: 2379 ExecStart=/usr/bin/telegraf -config /etc/telegraf/telegraf.conf -config-directory /etc/telegraf/telegraf.d $TELEGRAF_OPTS (code=exited, status=1/FAILURE)*
  • Main PID: 2379 (code=exited, status=1/FAILURE)*

Jul 24 09:18:55 d-ifdb-nm.vlab.lab systemd[1]: telegraf.service: Main process exited, code=exited, status=1/FAILURE
Jul 24 09:18:55 d-ifdb-nm.vlab.lab systemd[1]: telegraf.service: Failed with result ‘exit-code’.
Jul 24 09:18:55 d-ifdb-nm.vlab.lab systemd[1]: telegraf.service: Service RestartSec=100ms expired, scheduling restart.
Jul 24 09:18:55 d-ifdb-nm.vlab.lab systemd[1]: telegraf.service: Scheduled restart job, restart counter is at 6.
Jul 24 09:18:55 d-ifdb-nm.vlab.lab systemd[1]: Stopped The plugin-driven server agent for reporting metrics into InfluxDB.
Jul 24 09:18:55 d-ifdb-nm.vlab.lab systemd[1]: telegraf.service: Start request repeated too quickly.
Jul 24 09:18:55 d-ifdb-nm.vlab.lab systemd[1]: telegraf.service: Failed with result ‘exit-code’.
Jul 24 09:18:55 d-ifdb-nm.vlab.lab systemd[1]: Failed to start The plugin-driven server agent for reporting metrics into InfluxDB.
*[root@d-ifdb-nm ~]# systemctl status telegraf.service *
● telegraf.service - The plugin-driven server agent for reporting metrics into InfluxDB

  • Loaded: loaded (/usr/lib/systemd/system/telegraf.service; enabled; vendor preset: disabled)*
  • Active: failed (Result: exit-code) since Sun 2022-07-24 09:18:55 IST; 24min ago*
  • Docs: https://github.com/influxdata/telegraf*
  • Process: 2379 ExecStart=/usr/bin/telegraf -config /etc/telegraf/telegraf.conf -config-directory /etc/telegraf/telegraf.d $TELEGRAF_OPTS (code=exited, status=1/FAILURE)*
  • Main PID: 2379 (code=exited, status=1/FAILURE)*

Jul 24 09:18:55 d-ifdb-nm.vlab.lab systemd[1]: telegraf.service: Main process exited, code=exited, status=1/FAILURE
Jul 24 09:18:55 d-ifdb-nm.vlab.lab systemd[1]: telegraf.service: Failed with result ‘exit-code’.
Jul 24 09:18:55 d-ifdb-nm.vlab.lab systemd[1]: telegraf.service: Service RestartSec=100ms expired, scheduling restart.
Jul 24 09:18:55 d-ifdb-nm.vlab.lab systemd[1]: telegraf.service: Scheduled restart job, restart counter is at 6.
Jul 24 09:18:55 d-ifdb-nm.vlab.lab systemd[1]: Stopped The plugin-driven server agent for reporting metrics into InfluxDB.
Jul 24 09:18:55 d-ifdb-nm.vlab.lab systemd[1]: telegraf.service: Start request repeated too quickly.
Jul 24 09:18:55 d-ifdb-nm.vlab.lab systemd[1]: telegraf.service: Failed with result ‘exit-code’.
Jul 24 09:18:55 d-ifdb-nm.vlab.lab systemd[1]: Failed to start The plugin-driven server agent for reporting metrics into InfluxDB.

Looking for the Perfect Dashboard: InfluxDB, Telegraf and Grafana – Part XII (Native Telegraf Plugin for vSphere) - The Blog of Jorge de la Cruz

Thank You

2

Found out there was no telegraf.service file, so I created one with its contents taken from https://github.com/influxdata/telegraf/blob/master/scripts/telegraf.service then started systemctl daemon, then Telegraf.service, its up and running now.

Grafana still showing Templating Error, unsure why, Grafana logs are not showing anything…