Grafana not starting after update to 10.1.0

rikme · August 24, 2023, 6:33pm

Grafana on Raspberry Pi 4

Log entry:

logger=settings t=2023-08-24T20:23:03.460142197+02:00 level=info msg=“Config overridden from command line” arg=“default.paths.logs=/var/log/grafana”
logger=settings t=2023-08-24T20:23:03.460196753+02:00 level=info msg=“Config overridden from command line” arg=“default.paths.plugins=/var/lib/grafana/plugins”
logger=settings t=2023-08-24T20:23:03.460251104+02:00 level=info msg=“Config overridden from command line” arg=“default.paths.provisioning=/etc/grafana/provisioning”
logger=settings t=2023-08-24T20:23:03.460307789+02:00 level=info msg=Target target=[all]
logger=settings t=2023-08-24T20:23:03.460399511+02:00 level=info msg=“Path Home” path=/usr/share/grafana
logger=settings t=2023-08-24T20:23:03.460454159+02:00 level=info msg=“Path Data” path=/var/lib/grafana
logger=settings t=2023-08-24T20:23:03.460507881+02:00 level=info msg=“Path Logs” path=/var/log/grafana
logger=settings t=2023-08-24T20:23:03.460560158+02:00 level=info msg=“Path Plugins” path=/var/lib/grafana/plugins
logger=settings t=2023-08-24T20:23:03.460613047+02:00 level=info msg=“Path Provisioning” path=/etc/grafana/provisioning
logger=settings t=2023-08-24T20:23:03.460672528+02:00 level=info msg=“App mode production”
logger=sqlstore t=2023-08-24T20:23:03.461709893+02:00 level=info msg=“Connecting to DB” dbtype=sqlite3
logger=sqlstore t=2023-08-24T20:23:03.461821022+02:00 level=warn msg=“SQLite database file has broader permissions than it should” path=/var/lib/grafana/grafana.db mode=-rwxrwxrwx expected=-rw-r-----
logger=migrator t=2023-08-24T20:23:03.602687085+02:00 level=info msg=“Starting DB migrations”
logger=migrator t=2023-08-24T20:23:03.642098359+02:00 level=info msg=“migrations completed” performed=0 skipped=493 duration=3.761482ms
logger=secrets t=2023-08-24T20:23:03.646786169+02:00 level=info msg=“Envelope encryption state” enabled=true currentprovider=secretKey.v1
logger=plugin.loader t=2023-08-24T20:23:03.822335806+02:00 level=warn msg=“Plugin missing module.js” pluginID=input warning=“Missing module.js, If you loaded this plugin from git, make sure to compile it.”
logger=plugin.loader t=2023-08-24T20:23:03.822987432+02:00 level=info msg=“Plugin registered” pluginID=input
logger=local.finder t=2023-08-24T20:23:03.823337116+02:00 level=warn msg=“Skipping finding plugins as directory does not exist” path=/var/lib/grafana/plugins
logger=query_data t=2023-08-24T20:23:03.834028176+02:00 level=info msg=“Query Service initialization”
logger=live.push_http t=2023-08-24T20:23:03.844831235+02:00 level=info msg=“Live Push Gateway initialization”
logger=ngalert t=2023-08-24T20:23:03.868697824+02:00 level=warn msg=“Unexpected number of rows updating alert configuration history” rows=0 org=1 hash=e0528a75784033ae7b15c40851d89484

yosiasz · August 24, 2023, 6:34pm

what version did you update from?

rikme · August 24, 2023, 6:35pm

10.0.3

clevernessisamyth · August 24, 2023, 6:43pm

Can you do tail -f log_file and revisit the Grafana page to see the exact logs it produces.

yosiasz · August 24, 2023, 6:51pm

you downgraded? 10.0.3 to 10.1.0?

clevernessisamyth · August 24, 2023, 6:54pm

I think thats an upgrade. 10.1.0 > 10.0.3 xD

rikme · August 24, 2023, 7:02pm

logger=settings t=2023-08-24T21:01:29.94876407+02:00 level=info msg=“Starting Grafana” version=10.1.0 commit=838218ba20 branch=HEAD compiled=2023-08-23T12:52:21+02:00
logger=settings t=2023-08-24T21:01:29.949728841+02:00 level=info msg=“Config loaded from” file=/usr/share/grafana/conf/defaults.ini
logger=settings t=2023-08-24T21:01:29.949843174+02:00 level=info msg=“Config loaded from” file=/etc/grafana/grafana.ini
logger=settings t=2023-08-24T21:01:29.949899488+02:00 level=info msg=“Config overridden from command line” arg=“default.paths.data=/var/lib/grafana”
logger=settings t=2023-08-24T21:01:29.949963192+02:00 level=info msg=“Config overridden from command line” arg=“default.paths.logs=/var/log/grafana”
logger=settings t=2023-08-24T21:01:29.950016988+02:00 level=info msg=“Config overridden from command line” arg=“default.paths.plugins=/var/lib/grafana/plugins”
logger=settings t=2023-08-24T21:01:29.950074635+02:00 level=info msg=“Config overridden from command line” arg=“default.paths.provisioning=/etc/grafana/provisioning”
logger=settings t=2023-08-24T21:01:29.950137561+02:00 level=info msg=Target target=[all]
logger=settings t=2023-08-24T21:01:29.950233708+02:00 level=info msg=“Path Home” path=/usr/share/grafana
logger=settings t=2023-08-24T21:01:29.950288171+02:00 level=info msg=“Path Data” path=/var/lib/grafana
logger=settings t=2023-08-24T21:01:29.950343763+02:00 level=info msg=“Path Logs” path=/var/log/grafana
logger=settings t=2023-08-24T21:01:29.950401578+02:00 level=info msg=“Path Plugins” path=/var/lib/grafana/plugins
logger=settings t=2023-08-24T21:01:29.950459374+02:00 level=info msg=“Path Provisioning” path=/etc/grafana/provisioning
logger=settings t=2023-08-24T21:01:29.95051317+02:00 level=info msg=“App mode production”
logger=sqlstore t=2023-08-24T21:01:29.951557626+02:00 level=info msg=“Connecting to DB” dbtype=sqlite3
logger=migrator t=2023-08-24T21:01:30.082888716+02:00 level=info msg=“Starting DB migrations”
logger=migrator t=2023-08-24T21:01:30.125514526+02:00 level=info msg=“migrations completed” performed=0 skipped=493 duration=3.91064ms
logger=secrets t=2023-08-24T21:01:30.130484567+02:00 level=info msg=“Envelope encryption state” enabled=true currentprovider=secretKey.v1
logger=plugin.loader t=2023-08-24T21:01:30.32804994+02:00 level=warn msg=“Plugin missing module.js” pluginID=input warning=“Missing module.js, If you loaded this plugin from git, make sure to compile it.”
logger=plugin.loader t=2023-08-24T21:01:30.328939175+02:00 level=info msg=“Plugin registered” pluginID=input
logger=local.finder t=2023-08-24T21:01:30.329407005+02:00 level=warn msg=“Skipping finding plugins as directory does not exist” path=/var/lib/grafana/plugins
logger=query_data t=2023-08-24T21:01:30.340611875+02:00 level=info msg=“Query Service initialization”
logger=live.push_http t=2023-08-24T21:01:30.359405102+02:00 level=info msg=“Live Push Gateway initialization”

clevernessisamyth · August 24, 2023, 7:08pm

Check if this directory exists /var/lib/grafana/plugins and its permissions.

rikme · August 24, 2023, 7:10pm

nope it does not exist (but i’m also not using any external plugins to my knowledge)

clevernessisamyth · August 24, 2023, 7:13pm

Did you follow this documentation when you upgraded?

rikme · August 24, 2023, 7:14pm

Update was presented during regular RPi updates

clevernessisamyth · August 24, 2023, 7:15pm

The documentation says that you should run this command after an upgrade:

grafana cli plugins update-all

rikme · August 24, 2023, 7:26pm

Nope no change with that command. Downgraded back to 10.0.3 for now

yosiasz · August 24, 2023, 8:06pm

I cant read Is it arm? and which one?

jangaraj · August 24, 2023, 11:28pm

Perform standard debugging = increase log level to debug and show Grafana logs from failed login,pls.

pmoellmann1 · August 25, 2023, 6:53am

I have the same problem. I did an update for my raspberry. The new Version is v10.1.0
I can`t reach the dashboard anymore. I already tried to update the plugins with “sudo grafana-cli plugins update-all”

“grafana-cli plugins ls” tells me → “no installed plugins found”

The service is running. One problem … “Plugin missing module.js”

● grafana-server.service - Grafana instance
Loaded: loaded (/usr/lib/systemd/system/grafana-server.service; enabled; vendor preset: enabled)
Active: active (running) since Fri 2023-08-25 08:38:31 CEST; 18s ago
Docs: http://docs.grafana.org
Main PID: 1370 (grafana)
Tasks: 8 (limit: 4915)
CGroup: /system.slice/grafana-server.service
└─1370 /usr/share/grafana/bin/grafana server --config=/etc/grafana/grafana.ini --pidfile=/run/grafana/grafana-server.pid --packaging=deb cfg:default.paths.logs=/var/log/grafana cfg:default.paths.data=/var/lib/grafana cfg:defaul

Aug 25 08:38:37 raspberrypi-webcam grafana[1370]: logger=settings t=2023-08-25T08:38:37.700561863+02:00 level=info msg=“App mode production”
Aug 25 08:38:37 raspberrypi-webcam grafana[1370]: logger=sqlstore t=2023-08-25T08:38:37.70176627+02:00 level=info msg=“Connecting to DB” dbtype=sqlite3
Aug 25 08:38:37 raspberrypi-webcam grafana[1370]: logger=migrator t=2023-08-25T08:38:37.923904581+02:00 level=info msg=“Starting DB migrations”
Aug 25 08:38:37 raspberrypi-webcam grafana[1370]: logger=migrator t=2023-08-25T08:38:37.98153334+02:00 level=info msg=“migrations completed” performed=0 skipped=493 duration=4.086337ms
Aug 25 08:38:37 raspberrypi-webcam grafana[1370]: logger=secrets t=2023-08-25T08:38:37.986206492+02:00 level=info msg=“Envelope encryption state” enabled=true currentprovider=secretKey.v1
Aug 25 08:38:38 raspberrypi-webcam grafana[1370]: logger=plugin.loader t=2023-08-25T08:38:38.53797539+02:00 level=warn msg=“Plugin missing module.js” pluginID=input warning="Missing module.js, If you loaded this plugin from git, make sure
Aug 25 08:38:38 raspberrypi-webcam grafana[1370]: logger=plugin.loader t=2023-08-25T08:38:38.538537373+02:00 level=info msg=“Plugin registered” pluginID=input
Aug 25 08:38:38 raspberrypi-webcam grafana[1370]: logger=query_data t=2023-08-25T08:38:38.572420827+02:00 level=info msg=“Query Service initialization”
Aug 25 08:38:38 raspberrypi-webcam grafana[1370]: logger=live.push_http t=2023-08-25T08:38:38.585339669+02:00 level=info msg=“Live Push Gateway initialization”
Aug 25 08:38:38 raspberrypi-webcam grafana[1370]: logger=ngalert t=2023-08-25T08:38:38.615049678+02:00 level=warn msg=“Unexpected number of rows updating alert configuration history” rows=0 org=1 hash=8c409350c88d78d2ee938448449e628d
~

helgeschneider · August 25, 2023, 8:53am

Same problem here, Raspberry Pi, Grafanaupgrade from repo.

pmoellmann1 · August 25, 2023, 9:07am

Perhaps restoring an backup from /var/lib/grafana/plugin/ may help? Does anybody know or tested this?

helgeschneider · August 25, 2023, 12:07pm

I think module.js is missing: /usr/share/grafana/plugins-bundled/internal/input-datasource/module.js
“locate” shows me, that it was still there yesterday, not shure, but cron.daily updates index (updatedb)

pmoellmann1 · August 25, 2023, 12:51pm

But where do we get it from? I can`t find it at Github. I am not at home at the moment. I have to watch for an backup when I am back.