So during my trial and error tests I found that replacing/moving:
*Go to traces*: {{ .Annotations.traces }}
with:
*Silence alert*: {{ .SilenceURL }}
worked and now I can see it in the Slack alert message. I suspected some kind of character limit in single Slack message but it is not that. I would say this is a bug except there is another explanation for this.