Grafana not triggering alerts due to instance refresh

I have an alert rule that evaluates every 1min for 23min. Every around 5 minutes a new alert instance is created cancelling out the old one. Therefore alert is never triggered. Grafana 8.2.1

the instance refresh was caused due to a label that contained the value “{{$values.B}}”. So whenever a new value was received it would refresh the alert instance. I included that variable in the summary instead and delted the offending labell and it seems to work now.