I don’t understand these design choices at all.
I’ve got the same issue and haven’t found a setting or solution yet except downgrading to a previous version.
This user here says they solved it by using JavaScript to block loading of certain elements but I cannot believe there’s not an easier option.