How to fix label cardinality problem in existing loki setup?

I do understand that we should be using fewer labels for better performance in Loki. But I learnt it late and the hard way by having high label cardinality and now I have Loki setup having high label cardinality.
Is there a way to fix this in place so that we don’t loose logs?