Grafana docker container has CPU spikes and failes to load huge dashboards from multiple datasources

I wouldn’t say it contains complex queries, I am mostly displaying count of a query and I am querying over the last minute and no refresh - loads in 3-4minutes / it looks like in tries multiple times to display the values in the dashboard and only after a while it succeeds. Otherwise, it never loads.