Admin getting logged out frequently

bob454522 · October 14, 2020, 6:16pm

im running v7.2.0 (and has occured on prior versions).

The issue im having is since i enabled permissions (vs wide open access) about 2 months ago, im (admin) now getting frequently logged out after short (ie 15-30min) periods of inactivity from grafana.

This can be pretty troublesome if i have a dashboard open, then make a change/update to a panel, only the find out ive been logged out , when i go to press save dashboard.

Prior to 2 months ago, i never had this issue at all, however at that point is also when i created a 2nd “guest read-only” account, and also changed the dashboard permissions from “everyone”/wideopen access to the guest account can ONLY read-only access one, single, dashboard.

(i had access wide open, meaning no user restrictions, and no login passwords needed, as this was just a internal grafana install that only i myself used, and i secured it at the network level. then 2 months ago, i needed to give one single VPN-only user access to one dashboard).

i do see this in the logs, very frequently and assume its related:

grafana-server[113179]: t=2020-10-14T12:06:27-0500 lvl=eror msg="Failed to look up user based on cookie" logger=context error="user token not found"

here are some relevant settings from my grafana.ini (note i do embed some of my panels on a internal PRTG server/map, that is why i have to run:
enable_anonymous_access
and cookie_samesite = disabled

    [security]
# Auto-login remember days
;login_remember_days = 7
;cookie_username = grafana_user
;cookie_remember_name = grafana_remember

[users]
allow_sign_up = false

allow_org_create = false
;auto_assign_org = true
;auto_assign_org_role = Viewer

# enable anonymous access
enabled = true

[auth]
cookie_samesite = disabled
allow_embedding = true

# specify organization name that should be used for unauthenticated users
org_name = Main Org.

#commented out
##org_role = Editor
##org_role = Viewer

login_maximum_inactive_lifetime_duration = 30d

login_maximum_lifetime_duration = 90d

token_rotation_interval_minutes = 10

api_key_max_seconds_to_live = -1

thanks

codlord · October 14, 2020, 6:25pm

I had a logout problem when I updated to 7.2.0, I don’t know why this release had this affect, but I set token_rotation_interval_minutes and login_maximum_inactive_lifetime_days to high values and not had a problem since.

bob454522 · October 15, 2020, 7:30am

Thanks for the reply, i have made these changes (and i had to add login_maximum_inactive_lifetime_days , it was not in my grafana.ini).

so now the related settings look like this

login_maximum_inactive_lifetime_duration = 6M
login_maximum_inactive_lifetime_days = 90d
login_maximum_lifetime_duration = 90d
token_rotation_interval_minutes = 120

i then restarted grafana, and will update this thread with results.

bob454522 · October 15, 2020, 5:42pm

oh wow! grafana web was STILL logged in this morning when i came in. (that has not been the case in a few months!)

so, so far so good! will keep this updated, and mark as solution in a few days if all looks good.
thanks again for the reply!

EDIT: AWESOME!! ~48h now and still logged in! will mark as answer, and update if the issues comes back. but i think this fixed it! thanks for the reply/answer. (LOVE grafana!)

dpell352 · January 13, 2023, 7:48pm

I tried these settings and grafana is still logging out.

usman.ahmad · January 16, 2023, 12:46pm

Hi @dpell352,

What Grafana version you are using?

Also, could you please provide us with the backend logs (the default location in Linux is /var/log/grafana/grafana.log) so that we can have more information about the error message?

Thanks

dpell352 · January 16, 2023, 4:05pm

I’ll get that information for you tomorrow. I did resolve the problem. I had to rebuild the ini file from scratch. This worked. I didn’t find anything wrong with the original file.

Domenick Pellegrini
Network Operations/ Systems Administrator
14444 66th St. N.
Clearwater, FL 33764
727-533-2765 - Office
727-434-0837 - Mobile

dpell352 · January 25, 2023, 12:05pm

I’ve made all the changes suggested but we’re still getting log outs.

Here’s the grafana.log contents

logger=cleanup t=2023-01-25T00:03:55.618919182-05:00 level=info msg="Completed cleanup jobs" duration=192.633061ms
logger=cleanup t=2023-01-25T00:13:55.574637452-05:00 level=info msg="Completed cleanup jobs" duration=148.457725ms
logger=context userId=0 orgId=0 uname= t=2023-01-25T00:16:24.672619452-05:00 level=info msg="Request Completed" method=GET path=/d/mgMkEBO7k/stations-ird-4k status=302 remote_addr=10.132.182.212 time_ms=0 duration=863.034µs size=29 referer= handler=/d/:uid/:slug
logger=context userId=0 orgId=0 uname= t=2023-01-25T00:16:26.858103679-05:00 level=info msg="Request Completed" method=GET path=/d/jXJd4wHnk/ups-monitoring status=302 remote_addr=10.132.182.212 time_ms=0 duration=234.009µs size=29 referer=http://10.132.182.209:3000/login handler=/d/:uid/:slug
logger=cleanup t=2023-01-25T00:23:55.538855343-05:00 level=info msg="Completed cleanup jobs" duration=112.688713ms
logger=cleanup t=2023-01-25T00:33:55.536244964-05:00 level=info msg="Completed cleanup jobs" duration=110.397164ms
logger=cleanup t=2023-01-25T00:43:55.600276669-05:00 level=info msg="Completed cleanup jobs" duration=174.722332ms
logger=context userId=0 orgId=0 uname= t=2023-01-25T00:46:25.177706788-05:00 level=info msg="Request Completed" method=GET path=/d/mgMkEBO7k/stations-ird-4k status=302 remote_addr=10.132.182.212 time_ms=0 duration=585.194µs size=29 referer= handler=/d/:uid/:slug
logger=context userId=0 orgId=0 uname= t=2023-01-25T00:46:27.378069185-05:00 level=info msg="Request Completed" method=GET path=/d/jXJd4wHnk/ups-monitoring status=302 remote_addr=10.132.182.212 time_ms=0 duration=251.165µs size=29 referer=http://10.132.182.209:3000/login handler=/d/:uid/:slug
logger=cleanup t=2023-01-25T00:53:55.539398048-05:00 level=info msg="Completed cleanup jobs" duration=113.246693ms
logger=cleanup t=2023-01-25T01:03:55.55360712-05:00 level=info msg="Completed cleanup jobs" duration=127.341956ms
logger=cleanup t=2023-01-25T01:13:55.55921336-05:00 level=info msg="Completed cleanup jobs" duration=133.469179ms
logger=context userId=0 orgId=0 uname= t=2023-01-25T01:16:25.685419428-05:00 level=info msg="Request Completed" method=GET path=/d/mgMkEBO7k/stations-ird-4k status=302 remote_addr=10.132.182.212 time_ms=0 duration=852.784µs size=29 referer= handler=/d/:uid/:slug
logger=context userId=0 orgId=0 uname= t=2023-01-25T01:16:27.924127538-05:00 level=info msg="Request Completed" method=GET path=/d/jXJd4wHnk/ups-monitoring status=302 remote_addr=10.132.182.212 time_ms=0 duration=340.341µs size=29 referer=http://10.132.182.209:3000/login handler=/d/:uid/:slug
logger=cleanup t=2023-01-25T01:23:55.548296611-05:00 level=info msg="Completed cleanup jobs" duration=122.568579ms
logger=cleanup t=2023-01-25T01:33:55.529098926-05:00 level=info msg="Completed cleanup jobs" duration=102.853836ms
logger=cleanup t=2023-01-25T01:43:55.54373397-05:00 level=info msg="Completed cleanup jobs" duration=117.720744ms
logger=context userId=0 orgId=0 uname= t=2023-01-25T01:46:26.256589146-05:00 level=info msg="Request Completed" method=GET path=/d/mgMkEBO7k/stations-ird-4k status=302 remote_addr=10.132.182.212 time_ms=0 duration=862.933µs size=29 referer= handler=/d/:uid/:slug
logger=context userId=0 orgId=0 uname= t=2023-01-25T01:46:28.445445475-05:00 level=info msg="Request Completed" method=GET path=/d/jXJd4wHnk/ups-monitoring status=302 remote_addr=10.132.182.212 time_ms=0 duration=386.056µs size=29 referer=http://10.132.182.209:3000/login handler=/d/:uid/:slug
logger=cleanup t=2023-01-25T01:53:55.55829738-05:00 level=info msg="Completed cleanup jobs" duration=131.804719ms
logger=cleanup t=2023-01-25T02:03:55.539085546-05:00 level=info msg="Completed cleanup jobs" duration=113.034209ms
logger=cleanup t=2023-01-25T02:13:55.528260961-05:00 level=info msg="Completed cleanup jobs" duration=101.669294ms
logger=context userId=0 orgId=0 uname= t=2023-01-25T02:16:26.771720749-05:00 level=info msg="Request Completed" method=GET path=/d/mgMkEBO7k/stations-ird-4k status=302 remote_addr=10.132.182.212 time_ms=0 duration=897.935µs size=29 referer= handler=/d/:uid/:slug
logger=context userId=0 orgId=0 uname= t=2023-01-25T02:16:29.00076795-05:00 level=info msg="Request Completed" method=GET path=/d/jXJd4wHnk/ups-monitoring status=302 remote_addr=10.132.182.212 time_ms=0 duration=864.83µs size=29 referer=http://10.132.182.209:3000/login handler=/d/:uid/:slug
logger=cleanup t=2023-01-25T02:23:55.534103319-05:00 level=info msg="Completed cleanup jobs" duration=107.877412ms
logger=cleanup t=2023-01-25T02:33:55.539825483-05:00 level=info msg="Completed cleanup jobs" duration=113.558875ms
logger=cleanup t=2023-01-25T02:43:55.520637204-05:00 level=info msg="Completed cleanup jobs" duration=94.444785ms
logger=context userId=0 orgId=0 uname= t=2023-01-25T02:46:27.315926751-05:00 level=info msg="Request Completed" method=GET path=/d/mgMkEBO7k/stations-ird-4k status=302 remote_addr=10.132.182.212 time_ms=0 duration=453.557µs size=29 referer= handler=/d/:uid/:slug
logger=context userId=0 orgId=0 uname= t=2023-01-25T02:46:29.570722181-05:00 level=info msg="Request Completed" method=GET path=/d/jXJd4wHnk/ups-monitoring status=302 remote_addr=10.132.182.212 time_ms=0 duration=944.448µs size=29 referer=http://10.132.182.209:3000/login handler=/d/:uid/:slug
logger=cleanup t=2023-01-25T02:53:55.542966093-05:00 level=info msg="Completed cleanup jobs" duration=117.058553ms
logger=cleanup t=2023-01-25T03:03:55.548381441-05:00 level=info msg="Completed cleanup jobs" duration=121.958534ms
logger=cleanup t=2023-01-25T03:13:55.55393879-05:00 level=info msg="Completed cleanup jobs" duration=127.633452ms
logger=context userId=0 orgId=0 uname= t=2023-01-25T03:16:27.8140154-05:00 level=info msg="Request Completed" method=GET path=/d/mgMkEBO7k/stations-ird-4k status=302 remote_addr=10.132.182.212 time_ms=0 duration=314.187µs size=29 referer= handler=/d/:uid/:slug
logger=context userId=0 orgId=0 uname= t=2023-01-25T03:16:30.115593251-05:00 level=info msg="Request Completed" method=GET path=/d/jXJd4wHnk/ups-monitoring status=302 remote_addr=10.132.182.212 time_ms=0 duration=788.281µs size=29 referer=http://10.132.182.209:3000/login handler=/d/:uid/:slug
logger=cleanup t=2023-01-25T03:23:55.526300077-05:00 level=info msg="Completed cleanup jobs" duration=99.998822ms
logger=cleanup t=2023-01-25T03:33:55.523749261-05:00 level=info msg="Completed cleanup jobs" duration=97.863746ms
logger=context userId=1 orgId=1 uname=admin t=2023-01-25T03:36:09.655860684-05:00 level=info msg="Request Completed" method=GET path=/api/live/ws status=-1 remote_addr=10.132.178.80 time_ms=1 duration=1.761836ms size=0 referer= handler=/api/live/ws
logger=context userId=1 orgId=1 uname=admin t=2023-01-25T03:36:16.697183222-05:00 level=info msg="Request Completed" method=GET path=/api/live/ws status=-1 remote_addr=10.132.178.80 time_ms=1 duration=1.684447ms size=0 referer= handler=/api/live/ws
logger=cleanup t=2023-01-25T03:43:55.571194328-05:00 level=info msg="Completed cleanup jobs" duration=144.904475ms
logger=context userId=0 orgId=0 uname= t=2023-01-25T03:46:28.405982245-05:00 level=info msg="Request Completed" method=GET path=/d/mgMkEBO7k/stations-ird-4k status=302 remote_addr=10.132.182.212 time_ms=0 duration=456.07µs size=29 referer= handler=/d/:uid/:slug
logger=context userId=0 orgId=0 uname= t=2023-01-25T03:46:30.662937744-05:00 level=info msg="Request Completed" method=GET path=/d/jXJd4wHnk/ups-monitoring status=302 remote_addr=10.132.182.212 time_ms=0 duration=845.631µs size=29 referer=http://10.132.182.209:3000/login handler=/d/:uid/:slug
logger=cleanup t=2023-01-25T03:53:55.518583869-05:00 level=info msg="Completed cleanup jobs" duration=93.006436ms
logger=cleanup t=2023-01-25T04:03:55.566034227-05:00 level=info msg="Completed cleanup jobs" duration=139.977096ms
logger=cleanup t=2023-01-25T04:13:55.538442005-05:00 level=info msg="Completed cleanup jobs" duration=112.066355ms
logger=context userId=0 orgId=0 uname= t=2023-01-25T04:16:29.006494446-05:00 level=info msg="Request Completed" method=GET path=/d/mgMkEBO7k/stations-ird-4k status=302 remote_addr=10.132.182.212 time_ms=0 duration=850.157µs size=29 referer= handler=/d/:uid/:slug
logger=context userId=0 orgId=0 uname= t=2023-01-25T04:16:31.220420542-05:00 level=info msg="Request Completed" method=GET path=/d/jXJd4wHnk/ups-monitoring status=302 remote_addr=10.132.182.212 time_ms=0 duration=855.369µs size=29 referer=http://10.132.182.209:3000/login handler=/d/:uid/:slug
logger=context userId=1 orgId=1 uname=admin t=2023-01-25T04:22:35.907903846-05:00 level=info msg="Request Completed" method=GET path=/api/live/ws status=-1 remote_addr=10.132.178.80 time_ms=0 duration=607.043µs size=0 referer= handler=/api/live/ws
logger=cleanup t=2023-01-25T04:23:55.55266364-05:00 level=info msg="Completed cleanup jobs" duration=127.036232ms
logger=cleanup t=2023-01-25T04:33:55.541740956-05:00 level=info msg="Completed cleanup jobs" duration=115.411468ms
logger=context t=2023-01-25T04:41:06.807904448-05:00 level=warn msg="failed to look up session from cookie" error="user token not found"
logger=context t=2023-01-25T04:41:06.818679286-05:00 level=warn msg="failed to look up session from cookie" error="user token not found"
logger=context userId=0 orgId=0 uname= t=2023-01-25T04:41:06.819261058-05:00 level=info msg="Request Completed" method=POST path=/api/ds/query status=401 remote_addr=10.132.178.80 time_ms=442 duration=442.804157ms size=27 referer="http://10.132.182.209:3000/d/be8V8oOnk/satellite-return-monitoring?orgId=1&refresh=30s" handler=/api/ds/query
logger=context userId=0 orgId=0 uname= t=2023-01-25T04:41:06.819513139-05:00 level=info msg="Request Completed" method=POST path=/api/ds/query status=401 remote_addr=10.132.178.80 time_ms=444 duration=444.239071ms size=27 referer="http://10.132.182.209:3000/d/be8V8oOnk/satellite-return-monitoring?orgId=1&refresh=30s" handler=/api/ds/query
logger=context userId=0 orgId=0 uname= t=2023-01-25T04:41:06.8397692-05:00 level=info msg="Request Completed" method=GET path=/api/login/ping status=401 remote_addr=10.132.178.80 time_ms=0 duration=316.226µs size=26 referer="http://10.132.182.209:3000/d/be8V8oOnk/satellite-return-monitoring?orgId=1&refresh=30s" handler=/api/login/ping
logger=context userId=0 orgId=0 uname= t=2023-01-25T04:41:06.841944473-05:00 level=info msg="Request Completed" method=GET path=/api/login/ping status=401 remote_addr=10.132.178.80 time_ms=0 duration=186.014µs size=26 referer="http://10.132.182.209:3000/d/be8V8oOnk/satellite-return-monitoring?orgId=1&refresh=30s" handler=/api/login/ping
logger=context userId=0 orgId=0 uname= t=2023-01-25T04:41:06.851356891-05:00 level=info msg="Request Completed" method=GET path=/d/be8V8oOnk/satellite-return-monitoring status=302 remote_addr=10.132.178.80 time_ms=0 duration=222.695µs size=29 referer="http://10.132.182.209:3000/d/be8V8oOnk/satellite-return-monitoring?orgId=1&refresh=30s" handler=/d/:uid/:slug
logger=context userId=0 orgId=0 uname= t=2023-01-25T04:41:06.858243507-05:00 level=info msg="Request Completed" method=GET path=/d/be8V8oOnk/satellite-return-monitoring status=302 remote_addr=10.132.178.80 time_ms=0 duration=201.98µs size=29 referer="http://10.132.182.209:3000/d/be8V8oOnk/satellite-return-monitoring?orgId=1&refresh=30s" handler=/d/:uid/:slug
logger=cleanup t=2023-01-25T04:43:55.522419069-05:00 level=info msg="Completed cleanup jobs" duration=96.830822ms
logger=context userId=0 orgId=0 uname= t=2023-01-25T04:46:29.534319321-05:00 level=info msg="Request Completed" method=GET path=/d/mgMkEBO7k/stations-ird-4k status=302 remote_addr=10.132.182.212 time_ms=0 duration=879.773µs size=29 referer= handler=/d/:uid/:slug
logger=context userId=0 orgId=0 uname= t=2023-01-25T04:46:31.756371912-05:00 level=info msg="Request Completed" method=GET path=/d/jXJd4wHnk/ups-monitoring status=302 remote_addr=10.132.182.212 time_ms=0 duration=838.592µs size=29 referer=http://10.132.182.209:3000/login handler=/d/:uid/:slug
logger=cleanup t=2023-01-25T04:53:55.536584319-05:00 level=info msg="Completed cleanup jobs" duration=110.515421ms
logger=http.server t=2023-01-25T04:54:45.397278243-05:00 level=info msg="Successful Login" User=admin@localhost
logger=context userId=1 orgId=1 uname=admin t=2023-01-25T04:54:48.017271401-05:00 level=info msg="Request Completed" method=GET path=/api/live/ws status=-1 remote_addr=10.132.178.80 time_ms=1 duration=1.739697ms size=0 referer= handler=/api/live/ws
logger=cleanup t=2023-01-25T05:03:55.542373356-05:00 level=info msg="Completed cleanup jobs" duration=116.76733ms
logger=cleanup t=2023-01-25T05:13:55.539849724-05:00 level=info msg="Completed cleanup jobs" duration=113.751055ms
logger=context userId=0 orgId=0 uname= t=2023-01-25T05:16:30.114157769-05:00 level=info msg="Request Completed" method=GET path=/d/mgMkEBO7k/stations-ird-4k status=302 remote_addr=10.132.182.212 time_ms=0 duration=867.188µs size=29 referer= handler=/d/:uid/:slug
logger=context userId=0 orgId=0 uname= t=2023-01-25T05:16:32.290119127-05:00 level=info msg="Request Completed" method=GET path=/d/jXJd4wHnk/ups-monitoring status=302 remote_addr=10.132.182.212 time_ms=0 duration=820.822µs size=29 referer=http://10.132.182.209:3000/login handler=/d/:uid/:slug
logger=cleanup t=2023-01-25T05:23:55.537238387-05:00 level=info msg="Completed cleanup jobs" duration=111.119879ms
logger=cleanup t=2023-01-25T05:33:55.551296742-05:00 level=info msg="Completed cleanup jobs" duration=124.931536ms
logger=cleanup t=2023-01-25T05:43:55.532228604-05:00 level=info msg="Completed cleanup jobs" duration=105.90923ms
logger=context userId=0 orgId=0 uname= t=2023-01-25T05:46:30.635864-05:00 level=info msg="Request Completed" method=GET path=/d/mgMkEBO7k/stations-ird-4k status=302 remote_addr=10.132.182.212 time_ms=0 duration=875.786µs size=29 referer= handler=/d/:uid/:slug
logger=context userId=0 orgId=0 uname= t=2023-01-25T05:46:32.847768426-05:00 level=info msg="Request Completed" method=GET path=/d/jXJd4wHnk/ups-monitoring status=302 remote_addr=10.132.182.212 time_ms=0 duration=230.899µs size=29 referer=http://10.132.182.209:3000/login handler=/d/:uid/:slug
logger=cleanup t=2023-01-25T05:53:55.529660803-05:00 level=info msg="Completed cleanup jobs" duration=103.57913ms
logger=cleanup t=2023-01-25T06:03:55.543731826-05:00 level=info msg="Completed cleanup jobs" duration=117.602093ms
logger=cleanup t=2023-01-25T06:13:55.550019132-05:00 level=info msg="Completed cleanup jobs" duration=123.669414ms
logger=context userId=0 orgId=0 uname= t=2023-01-25T06:16:31.185362875-05:00 level=info msg="Request Completed" method=GET path=/d/mgMkEBO7k/stations-ird-4k status=302 remote_addr=10.132.182.212 time_ms=1 duration=1.004242ms size=29 referer= handler=/d/:uid/:slug
logger=context userId=0 orgId=0 uname= t=2023-01-25T06:16:33.347233684-05:00 level=info msg="Request Completed" method=GET path=/d/jXJd4wHnk/ups-monitoring status=302 remote_addr=10.132.182.212 time_ms=0 duration=235.346µs size=29 referer=http://10.132.182.209:3000/login handler=/d/:uid/:slug
logger=cleanup t=2023-01-25T06:23:55.546969907-05:00 level=info msg="Completed cleanup jobs" duration=120.659149ms
logger=cleanup t=2023-01-25T06:33:55.552929243-05:00 level=info msg="Completed cleanup jobs" duration=126.623669ms
logger=cleanup t=2023-01-25T06:43:55.542225579-05:00 level=info msg="Completed cleanup jobs" duration=115.69338ms
logger=context userId=0 orgId=0 uname= t=2023-01-25T06:46:31.781555689-05:00 level=info msg="Request Completed" method=GET path=/d/mgMkEBO7k/stations-ird-4k status=302 remote_addr=10.132.182.212 time_ms=0 duration=876.108µs size=29 referer= handler=/d/:uid/:slug
logger=context userId=0 orgId=0 uname= t=2023-01-25T06:46:33.898657097-05:00 level=info msg="Request Completed" method=GET path=/d/jXJd4wHnk/ups-monitoring status=302 remote_addr=10.132.182.212 time_ms=0 duration=824.902µs size=29 referer=http://10.132.182.209:3000/login handler=/d/:uid/:slug
logger=cleanup t=2023-01-25T06:53:55.531640731-05:00 level=info msg="Completed cleanup jobs" duration=105.105459ms
logger=context t=2023-01-25T06:54:51.405965582-05:00 level=warn msg="failed to look up session from cookie" error="user token not found"
logger=context userId=0 orgId=0 uname= t=2023-01-25T06:54:51.406995382-05:00 level=info msg="Request Completed" method=POST path=/api/ds/query status=401 remote_addr=10.132.178.80 time_ms=648 duration=648.244865ms size=27 referer="http://10.132.182.209:3000/d/be8V8oOnk/satellite-return-monitoring?orgId=1&refresh=30s" handler=/api/ds/query
logger=context t=2023-01-25T06:54:51.534165679-05:00 level=warn msg="failed to look up session from cookie" error="user token not found"
logger=context userId=0 orgId=0 uname= t=2023-01-25T06:54:51.53506126-05:00 level=info msg="Request Completed" method=POST path=/api/ds/query status=401 remote_addr=10.132.178.80 time_ms=763 duration=763.725843ms size=27 referer="http://10.132.182.209:3000/d/be8V8oOnk/satellite-return-monitoring?orgId=1&refresh=30s" handler=/api/ds/query
logger=context userId=0 orgId=0 uname= t=2023-01-25T06:54:51.618159107-05:00 level=info msg="Request Completed" method=GET path=/api/login/ping status=401 remote_addr=10.132.178.80 time_ms=79 duration=79.445014ms size=26 referer="http://10.132.182.209:3000/d/be8V8oOnk/satellite-return-monitoring?orgId=1&refresh=30s" handler=/api/login/ping
logger=context t=2023-01-25T06:54:51.639645748-05:00 level=warn msg="failed to look up session from cookie" error="user token not found"
logger=context userId=0 orgId=0 uname= t=2023-01-25T06:54:51.640634792-05:00 level=info msg="Request Completed" method=POST path=/api/ds/query status=401 remote_addr=10.132.178.80 time_ms=330 duration=330.962214ms size=27 referer="http://10.132.182.209:3000/d/be8V8oOnk/satellite-return-monitoring?orgId=1&refresh=30s" handler=/api/ds/query
logger=context userId=0 orgId=0 uname= t=2023-01-25T06:54:51.748166199-05:00 level=info msg="Request Completed" method=GET path=/api/login/ping status=401 remote_addr=10.132.178.80 time_ms=104 duration=104.549867ms size=26 referer="http://10.132.182.209:3000/d/be8V8oOnk/satellite-return-monitoring?orgId=1&refresh=30s" handler=/api/login/ping
logger=context userId=0 orgId=0 uname= t=2023-01-25T06:54:51.755650463-05:00 level=info msg="Request Completed" method=GET path=/d/be8V8oOnk/satellite-return-monitoring status=302 remote_addr=10.132.178.80 time_ms=0 duration=750.798µs size=29 referer="http://10.132.182.209:3000/d/be8V8oOnk/satellite-return-monitoring?orgId=1&refresh=30s" handler=/d/:uid/:slug
logger=context userId=1 orgId=1 uname=admin t=2023-01-25T06:54:51.756332297-05:00 level=error msg="Request error" error="Context.HTML:write tcp 10.132.182.209:3000->10.132.178.80:57282: write: broken pipe" stack="/drone/src/pkg/web/context.go:102 (0x102305c)\n/drone/src/pkg/api/index.go:171 (0x22be5f0)\n/drone/src/pkg/api/response/web_hack.go:40 (0x119a035)\n/usr/local/go/src/net/http/server.go:2109 (0x71c16e)\n/drone/src/pkg/web/macaron.go:135 (0x10241f4)\n/usr/local/go/src/net/http/server.go:2109 (0x71c16e)\n/drone/src/pkg/web/macaron.go:141 (0x102429b)\n/usr/local/go/src/net/http/server.go:2109 (0x71c16e)\n/drone/src/pkg/web/macaron.go:141 (0x102429b)\n/usr/local/go/src/net/http/server.go:2109 (0x71c16e)\n/drone/src/pkg/web/macaron.go:141 (0x102429b)\n/usr/local/go/src/net/http/server.go:2109 (0x71c16e)\n/drone/src/pkg/middleware/csp.go:22 (0x1889852)\n/usr/local/go/src/net/http/server.go:2109 (0x71c16e)\n/drone/src/pkg/web/macaron.go:141 (0x102429b)\n/usr/local/go/src/net/http/server.go:2109 (0x71c16e)\n/drone/src/pkg/web/macaron.go:141 (0x102429b)\n/usr/local/go/src/net/http/server.go:2109 (0x71c16e)\n/drone/src/pkg/web/macaron.go:141 (0x102429b)\n/usr/local/go/src/net/http/server.go:2109 (0x71c16e)\n/drone/src/pkg/services/contexthandler/contexthandler.go:196 (0x187b059)\n/usr/local/go/src/net/http/server.go:2109 (0x71c16e)\n/drone/src/pkg/web/macaron.go:141 (0x102429b)\n/usr/local/go/src/net/http/server.go:2109 (0x71c16e)\n/drone/src/pkg/web/macaron.go:141 (0x102429b)\n/usr/local/go/src/net/http/server.go:2109 (0x71c16e)\n/drone/src/pkg/web/macaron.go:141 (0x102429b)\n/usr/local/go/src/net/http/server.go:2109 (0x71c16e)\n/drone/src/pkg/web/macaron.go:141 (0x102429b)\n/usr/local/go/src/net/http/server.go:2109 (0x71c16e)\n/drone/src/pkg/web/macaron.go:141 (0x102429b)\n/usr/local/go/src/net/http/server.go:2109 (0x71c16e)\n/drone/src/pkg/web/render.go:44 (0x1024db5)\n/usr/local/go/src/net/http/server.go:2109 (0x71c16e)\n/drone/src/pkg/web/macaron.go:141 (0x102429b)\n/usr/local/go/src/net/http/server.go:2109 (0x71c16e)\n/drone/src/pkg/web/macaron.go:141 (0x102429b)\n/usr/local/go/src/net/http/server.go:2109 (0x71c16e)\n/drone/src/pkg/web/macaron.go:141 (0x102429b)\n/usr/local/go/src/net/http/server.go:2109 (0x71c16e)\n/drone/src/pkg/web/macaron.go:141 (0x102429b)\n/usr/local/go/src/net/http/server.go:2109 (0x71c16e)\n/drone/src/pkg/middleware/csrf/csrf.go:64 (0x1fdf825)\n/usr/local/go/src/net/http/server.go:2109 (0x71c16e)\n/drone/src/pkg/middleware/recovery.go:171 (0x188d181)\n/usr/local/go/src/net/http/server.go:2109 (0x71c16e)\n/drone/src/pkg/middleware/logger.go:42 (0x188ab3d)\n/usr/local/go/src/net/http/server.go:2109 (0x71c16e)\n/drone/src/pkg/middleware/request_metrics.go:58 (0x188df89)\n/usr/local/go/src/net/http/server.go:2109 (0x71c16e)\n/drone/src/pkg/middleware/request_tracing.go:88 (0x188f6da)\n/usr/local/go/src/net/http/server.go:2109 (0x71c16e)\n/drone/src/pkg/web/context.go:49 (0x1022b7d)\n/drone/src/pkg/web/router.go:155 (0x102632d)\n/drone/src/pkg/web/router.go:221 (0x1026f71)\n/drone/src/pkg/web/macaron.go:167 (0x1024710)\n/usr/local/go/src/net/http/server.go:2947 (0x71f56b)\n/usr/local/go/src/net/http/server.go:1991 (0x71ac46)\n/usr/local/go/src/runtime/asm_amd64.s:1594 (0x478300)\n"
logger=http.server t=2023-01-25T06:59:58.316748197-05:00 level=info msg="Successful Login" User=admin@localhost
logger=context userId=1 orgId=1 uname=admin t=2023-01-25T07:00:00.861531493-05:00 level=info msg="Request Completed" method=GET path=/api/live/ws status=-1 remote_addr=10.132.178.80 time_ms=0 duration=501.026µs size=0 referer= handler=/api/live/ws

usman.ahmad · January 25, 2023, 1:12pm

Hi @dpell352 ,

Thanks for the logs. Not exactly sure what grafana version you are currently using. However, in the logs I found this error message multiple times.

logger=context t=2023-01-25T06:54:51.639645748-05:00 level=warn msg="failed to look up session from cookie" error="user token not found"

This seems to be a known issue in the recent ver. 9.3.2 which got reported on our GitHub repo:

github.com/grafana/grafana

Error: failed to look up session from cookie

opened 07:46AM - 12 Jan 23 UTC

closed 11:40AM - 12 Jan 23 UTC

iBelow

**What happened**: after some time grafana logout all users with error ``` lo…gger=context t=2023-01-12T10:26:49.779072173+03:00 level=warn msg="failed to look up session from cookie" error="user token not found" logger=context t=2023-01-12T10:26:49.779294689+03:00 level=warn msg="failed to look up session from cookie" error="user token not found" ``` and ``` logger=context t=2023-01-12T10:44:31.118535705+03:00 level=warn msg="failed to look up session from cookie" error="database is locked" ``` but... i havent db, i'm use only some integrations **What you expected to happen**: **How to reproduce it (as minimally and precisely as possible)**: **Anything else we need to know?**: grafana upgraded from 8.3 to [v9.3.2 (21c1d14e91)](https://github.com/grafana/grafana/blob/main/CHANGELOG.md) **Environment**: - Grafana version: [v9.3.2 (21c1d14e91)](https://github.com/grafana/grafana/blob/main/CHANGELOG.md) - Data source type & version: - OS Grafana is installed on: linux as service (via binary) - User OS & Browser: Google chrome 108.0.5359.126 - Grafana plugins: - Others: config is default, not changed manually; using nginx, and all works good on previous version [auth] ``` # Login cookie name ;login_cookie_name = grafana_session # The maximum lifetime (duration) an authenticated user can be inactive before being required to login at next visit. Default is 7 days (7d). This setting should be expressed as a duration, e.g. 5m (minutes),>;login_maximum_inactive_lifetime_duration = # The maximum lifetime (duration) an authenticated user can be logged in since login time before being required to login. Default is 30 days (30d). This setting should be expressed as a duration, e.g. 5m (min>;login_maximum_lifetime_duration = # How often should auth tokens be rotated for authenticated users when being active. The default is each 10 minutes. ;token_rotation_interval_minutes = 10 # Set to true to disable (hide) the login form, useful if you use OAuth, defaults to false ;disable_login_form = false # Set to true to disable the signout link in the side menu. useful if you use auth.proxy, defaults to false ;disable_signout_menu = false # URL to redirect the user to after sign out ;signout_redirect_url = # Set to true to attempt login with OAuth automatically, skipping the login screen. # This setting is ignored if multiple OAuth providers are configured. ;oauth_auto_login = false # OAuth state max age cookie duration in seconds. Defaults to 600 seconds. ;oauth_state_cookie_max_age = 600 # limit of api_key seconds to live before expiration ;api_key_max_seconds_to_live = -1 # Set to true to enable SigV4 authentication option for HTTP-based datasources. ;sigv4_auth_enabled = false ```

Luckily the same user found a way to fix it. So please try to do that and let us know if this helps.

dpell352 · January 25, 2023, 1:30pm

v9.3.2 (21c1d14e91)

So my question is, can this be upgraded? If yes, what’s the recommended version? Will upgrading wipe all of my graphs or is there a way to back the system up and reapply all of the configurations?

usman.ahmad · January 26, 2023, 11:19am

Hi @dpell352,

So you are already using a recent version of Grafana and as the issue was solved by the user so seems like an issue with the Database stability.

SQLite is good for local test env. or in small production env. where there is not much going on. However, the recommendation is to use e.g. MySQL or Postgres etc as the backend Database which provides more stability and better performance in the longer run.

For the back question, we do have documentation which describes how to take backup.

Also, check this post where community users shared some more valuable tips for the backup n restore.

For the last part of backing up Dashboards, you can check here as it list some 3rd party scripts which are related to Dashboard import n export.

Let us know if this helps.

dpell352 · January 26, 2023, 11:39am

Thanks. Our Grafana implementation was with InfluxDB. I don’t know why that was used and not MySQL or Postgres. I’m guessing that to migrate would be difficult. I’ll have to see if there are any settings on the database side that can resolve the issue. I’ll check out the links.

Thanks again.