Grafana playlist displays wrong annotations

My playlist has 2 dashboards.
The 1st one displays annotation for one service, the 2nd displays annotations for a different service.
If I start the playlist I see that the annotations don’t change no matter which dashboard is being displayed.
If I stop the playlist and go to the 2nd dashboard directly, I can see the correct annotations. Kindly suggest how I can see the correct annotations for each service during play run. Grafana version - 5.4.2
Thanks