Hi everyone.
Suddenly we have some problems with all our dashboards in Grafana.
All dashboards when we try to open, even with the admin account, we receive the error:
Application error. Account is blocked for 30 seconds.
“status:500
statusText:“Internal Server Error”
data:Object
error:“Internal Server Error”
message:“Application error. Account is blocked for 3 seconds.”
config:Object
url:“api/datasources/1/resources/zabbix-api”
method:“POST”
headers:Object
hideFromInspector:false
data:Object
retry:0
message:“Application error. Account is blocked for 3 seconds.””
Some of Dashboards we also get this error:
db query error: Error 1064: You have an error in your SQL syntax; check the manual that corresponds to your MariaDB server version for the right syntax to use near ‘’ at line 25
Anyone has a clue here?
Thanks.
Also, grafana-server I think thats ok:
WARN[04-26|13:56:10] falling back to legacy setting of ‘min_interval_seconds’; please use the configuration option in the unified_alerting section if Grafana 8 alerts are enabled. logger=settings
WARN[04-26|13:56:10] falling back to legacy setting of ‘min_interval_seconds’; please use the configuration option in the unified_alerting section if Grafana 8 alerts are enabled. logger=settings
INFO[04-26|13:56:10] Config loaded from logger=settings file=/usr/share/grafana/conf/defaults.ini
INFO[04-26|13:56:10] Path Home logger=settings path=/usr/share/grafana
INFO[04-26|13:56:10] Path Data logger=settings path=/usr/share/grafana/data
INFO[04-26|13:56:10] Path Logs logger=settings path=/usr/share/grafana/data/log
INFO[04-26|13:56:10] Path Plugins logger=settings path=/usr/share/grafana/data/plugins
INFO[04-26|13:56:10] Path Provisioning logger=settings path=/usr/share/grafana/conf/provisioning
INFO[04-26|13:56:10] App mode production logger=settings
INFO[04-26|13:56:10] Connecting to DB logger=sqlstore dbtype=sqlite3
INFO[04-26|13:56:10] Starting DB migrations logger=migrator
INFO[04-26|13:56:10] migrations completed logger=migrator performed=0 skipped=346 duration=816.571µs
INFO[04-26|13:56:10] Starting plugin search logger=plugins
INFO[04-26|13:56:10] Registering plugin logger=plugins id=input
INFO[04-26|13:56:10] Live Push Gateway initialization logger=live.push_http
EROR[04-26|13:56:10] Stopped background service *api.HTTPServer logger=server reason=“failed to open listener on address 0.0.0.0:3000: listen tcp 0.0.0.0:3000: bind: address already in use”
EROR[04-26|13:56:10] failed to lock and execute cleanup of expired auth token logger=auth error=“context canceled”
EROR[04-26|13:56:10] Server shutdown logger=server error="*api.HTTPServer run error: failed to open listener on address 0.0.0.0:3000: listen tcp 0.0.0.0:3000: bind: address already in use"
Those are the plugins that I have:
installed plugins:
agenty-flowcharting-panel @ 0.9.1
alexanderzobnin-zabbix-app @ 4.2.4
fzakaria-simple-annotations-datasource @ 1.0.1
grafana-clock-panel @ 1.2.0
grafana-csv-plugin @ 2.0.0
grafana-piechart-panel @ 1.6.2
grafana-polystat-panel @ 1.2.7
grafana-worldmap-panel @ 0.2.1
novalabs-annotations-panel @ 0.0.2
ryantxu-ajax-panel @ 0.1.0
vonage-status-panel @ 1.0.11
Please restart Grafana after installing plugins. Refer to Grafana documentation for instructions if necessary.
Another problem that I found, I dont know if that is related to the issue, but check the output of the grafana-server service:
[root@SERVER init.d]# ./grafana-server status
grafana-server dead but pid file exists
And I can access normally in web, as I said before.
Thanks!
do you have a few grafana vizs with different mariadb and zabbix data sources?
- what user do you have for your zabbix connection?
- what user do you have for your Mariadb connection?
looks like a few issues you need to touch base with your db admin and zabbix admin
Are you cloud or on prem?
yosiasz,
hi.
No, I only have Zabbix Default Data Source.
1 - Admin
2 - We use MySQL, and its Admin user.
We are on prem.
yosiasz,
I’ve checked here and for Zabbix we use MySQL, but we have MariaDB process running too.
mysql 1966 12.8 58.7 9835860 5294780 ? Sl Mar25 5934:12 /usr/libexec/mysqld --basedir=/usr --datadir=/mysql/mysql_db/ --plugin-dir=/usr/lib64/mysql/plugin --log-error=/var/log/mariadb/mariadb.log --pid-file=/var/run/mariadb/mariadb.pid --socket=/var/lib/mysql/mysql.sock
root 6808 0.0 0.0 112836 980 pts/0 S+ 15:51 0:00 grep --color=auto mariadb
so this above must correspond to MySQL ^
How are you connecting to this mysql server? username and password?
So did you recently upgrade grafana?
Yosiasz,
I recently have not updated the Grafana 
if you search for that error: Application error. Account is blocked for 3 seconds.” it seems related to zabbix and not grafana. Something must have changed either in the query for zabbix or something else.
Is anything here are you saying?
Ok, understood.
But I dont have a clue how to begin the troubleshoot
Just reporting, I was able to resolve the problem.
The problem was the account that connects with Zabbix API.
Now everything is fine.
1 Like
Hello.
I would like to know what you modified that I also encountered this problem
We look forward to receiving your reply
