Grafana server not starting after installing grafana-image-renderer. Fork/exec permission denied error

Hello Everyone,

  • What Grafana version and what operating system are you using?
    I am setting up a new Grafana environment. I have installed Grafana 10.2.6 but after installing the Grafana Image Renderer, the grafana-server does not start properly anymore.

I instlaled the Image renderer using:
[root@icinga-master-test plugins]# grafana cli plugins install grafana-image-renderer

which resulted in installing grafana-image-renderer v3.12.2

  • What are you trying to achieve?
    Trying to start grafana-server with the grafana-image-renderer already installed

  • How are you trying to achieve it?
    #systemctl restart grafana-server

  • What happened?
    [root@icinga-master-test grafana-image-renderer]# systemctl status grafana-server
    × grafana-server.service - Grafana instance
    Loaded: loaded (/usr/lib/systemd/system/grafana-server.service; enabled; preset: disabled)
    Active: failed (Result: exit-code) since Mon 2025-03-10 18:01:21 EET; 12min ago
    Duration: 11ms
    Docs: http://docs.grafana.org
    Process: 14088 ExecStart=/usr/sbin/grafana server --config=${CONF_FILE} --pidfile=${PID_FILE_DIR}/grafana-server.pid --packaging=rpm cfg:default.paths.logs=${LOG_DIR} cfg:default.paths.data=${DATA_DIR} cfg:default.paths.p>
    Main PID: 14088 (code=exited, status=1/FAILURE)
    CPU: 404ms

Mar 10 18:01:21 icinga-master-test systemd[1]: grafana-server.service: Scheduled restart job, restart counter is at 5.
Mar 10 18:01:21 icinga-master-test systemd[1]: Stopped Grafana instance.
Mar 10 18:01:21 icinga-master-test systemd[1]: grafana-server.service: Start request repeated too quickly.
Mar 10 18:01:21 icinga-master-test systemd[1]: grafana-server.service: Failed with result ‘exit-code’.
Mar 10 18:01:21 icinga-master-test systemd[1]: Failed to start Grafana instance.

Using journalctl to check further logs I have the following:
[root@icinga-master-test grafana-image-renderer]# journalctl -u grafana-server |grep “18:01” |grep err
Mar 10 18:01:17 icinga-master-test grafana[13992]: logger=settings t=2025-03-10T18:01:17.979421391+02:00 level=info msg=“Config overridden from command line” arg=“default.paths.data=/var/lib/grafana”
Mar 10 18:01:17 icinga-master-test grafana[13992]: logger=settings t=2025-03-10T18:01:17.979424332+02:00 level=info msg=“Config overridden from command line” arg=“default.paths.logs=/var/log/grafana”
Mar 10 18:01:17 icinga-master-test grafana[13992]: logger=settings t=2025-03-10T18:01:17.979427008+02:00 level=info msg=“Config overridden from command line” arg=“default.paths.plugins=/var/lib/grafana/plugins”
Mar 10 18:01:17 icinga-master-test grafana[13992]: logger=settings t=2025-03-10T18:01:17.979429606+02:00 level=info msg=“Config overridden from command line” arg=“default.paths.provisioning=/etc/grafana/provisioning”
Mar 10 18:01:18 icinga-master-test grafana[13992]: logger=server t=2025-03-10T18:01:18.309319923+02:00 level=error msg=“Stopped background service” service=*rendering.RenderingService reason=“fork/exec /var/lib/grafana/plugins/grafana-image-renderer/plugin_start_linux_amd64: permission denied”
*Mar 10 18:01:18 icinga-master-test grafana[13992]: Error: ✗ rendering.RenderingService run error: fork/exec /var/lib/grafana/plugins/grafana-image-renderer/plugin_start_linux_amd64: permission denied

I have installed chromium and seems that there are no missing libraries when checking with:

ldd /var/lib/grafana/plugins/grafana-image-renderer/chrome-headless-shell/linux-136.0.7052.0/chrome-headless-shell-linux64/chrome-headless-shell

linux-vdso.so.1 (0x00007ffc8adef000)
libdl.so.2 => /lib64/libdl.so.2 (0x00007f86a2719000)
libpthread.so.0 => /lib64/libpthread.so.0 (0x00007f86a2714000)
libgobject-2.0.so.0 => /lib64/libgobject-2.0.so.0 (0x00007f86a26b9000)
libglib-2.0.so.0 => /lib64/libglib-2.0.so.0 (0x00007f86a257e000)
libnss3.so => /lib64/libnss3.so (0x00007f86a2449000)
libnssutil3.so => /lib64/libnssutil3.so (0x00007f86a2415000)
libnspr4.so => /lib64/libnspr4.so (0x00007f86a23d0000)
libdbus-1.so.3 => /lib64/libdbus-1.so.3 (0x00007f86a237d000)
libatk-1.0.so.0 => /lib64/libatk-1.0.so.0 (0x00007f86a2354000)
libatk-bridge-2.0.so.0 => /lib64/libatk-bridge-2.0.so.0 (0x00007f86a231b000)
libgio-2.0.so.0 => /lib64/libgio-2.0.so.0 (0x00007f86a2148000)
libexpat.so.1 => /lib64/libexpat.so.1 (0x00007f86a2117000)
libatspi.so.0 => /lib64/libatspi.so.0 (0x00007f86a20d8000)
libm.so.6 => /lib64/libm.so.6 (0x00007f86a1ffd000)
libX11.so.6 => /lib64/libX11.so.6 (0x00007f86a1eb5000)
libXcomposite.so.1 => /lib64/libXcomposite.so.1 (0x00007f86a1eb0000)
libXdamage.so.1 => /lib64/libXdamage.so.1 (0x00007f86a1eab000)
libXext.so.6 => /lib64/libXext.so.6 (0x00007f86a1e96000)
libXfixes.so.3 => /lib64/libXfixes.so.3 (0x00007f86a1e8b000)
libXrandr.so.2 => /lib64/libXrandr.so.2 (0x00007f86a1e7e000)
libgbm.so.1 => /lib64/libgbm.so.1 (0x00007f86a1e6c000)
libxcb.so.1 => /lib64/libxcb.so.1 (0x00007f86a1e41000)
libxkbcommon.so.0 => /lib64/libxkbcommon.so.0 (0x00007f86a1dfc000)
libudev.so.1 => /lib64/libudev.so.1 (0x00007f86a1dca000)
libasound.so.2 => /lib64/libasound.so.2 (0x00007f86a1cb8000)
libgcc_s.so.1 => /lib64/libgcc_s.so.1 (0x00007f86a1c9d000)
libc.so.6 => /lib64/libc.so.6 (0x00007f86a1a95000)
/lib64/ld-linux-x86-64.so.2 (0x00007f86ad655000)
libffi.so.8 => /lib64/libffi.so.8 (0x00007f86a1a89000)
libpcre.so.1 => /lib64/libpcre.so.1 (0x00007f86a1a11000)
libplc4.so => /lib64/libplc4.so (0x00007f86a1a0a000)
libplds4.so => /lib64/libplds4.so (0x00007f86a1a03000)
libsystemd.so.0 => /lib64/libsystemd.so.0 (0x00007f86a1924000)
libgmodule-2.0.so.0 => /lib64/libgmodule-2.0.so.0 (0x00007f86a191e000)
libz.so.1 => /lib64/libz.so.1 (0x00007f86a1904000)
libmount.so.1 => /lib64/libmount.so.1 (0x00007f86a18bf000)
libselinux.so.1 => /lib64/libselinux.so.1 (0x00007f86a1892000)
libXi.so.6 => /lib64/libXi.so.6 (0x00007f86a187e000)
libXrender.so.1 => /lib64/libXrender.so.1 (0x00007f86a1871000)
libdrm.so.2 => /lib64/libdrm.so.2 (0x00007f86a185a000)
libwayland-server.so.0 => /lib64/libwayland-server.so.0 (0x00007f86a1844000)
libxcb-randr.so.0 => /lib64/libxcb-randr.so.0 (0x00007f86a1831000)
libXau.so.6 => /lib64/libXau.so.6 (0x00007f86a1829000)
libcap.so.2 => /lib64/libcap.so.2 (0x00007f86a181f000)
libgcrypt.so.20 => /lib64/libgcrypt.so.20 (0x00007f86a16e6000)
liblzma.so.5 => /lib64/liblzma.so.5 (0x00007f86a16ba000)
libzstd.so.1 => /lib64/libzstd.so.1 (0x00007f86a15e3000)
liblz4.so.1 => /lib64/liblz4.so.1 (0x00007f86a15bd000)
libblkid.so.1 => /lib64/libblkid.so.1 (0x00007f86a1585000)
libpcre2-8.so.0 => /lib64/libpcre2-8.so.0 (0x00007f86a14e9000)
libgpg-error.so.0 => /lib64/libgpg-error.so.0 (0x00007f86a14c3000)

Probably this fork/exec … permission denied is causing the problem. What could be the possible reason and what can I try to fix it?
I also tried to install older version of the image renderer. I tried with 3.10.0 and 3.7.0 but the result is the same as with the latest 3.12.0

Any help will be highly appreciated.

Thanks.