Grafana annotations per panel

I have use case where I should create annotations per panel level like memory outage annotations in one panel, CPU outage annotations in another panel.