Grafana notifications for Prom Alert Rules from Prometheus datasource

I have a grafana instance set up that is connected to a prometheus instance as datasource. It pulls alert rules from the prometheus instance and I can see the alerts and their status in the grafana UI.
However the grafana alert notifications are not sent for those alert rules. But I do receive alert notifications for the other alerts that are defined directly in the Grafana UI. Is there a way to enable grafana notifications for the alert rules imported from prometheus ?