Grafana is not sending alerts to Telegram

#1

Hi Team,

I’m using Grafana 7.0.3 & InfluxDB 1.8. I’ve configured alerts for mail & Telegram, verified the created notification channel with test alert. I’ve configured same alerts for mail & Telegram, but some of the alerts are not getting triggered/not reaching Telegram group.
I’ve also enabled debug logs for Grafana but couldn’t find any Telegram related error. Is there a way to fix/debug this ? Is there a limit on the telegram alerts that can be sent in a day? I understand that there’s a constraint on message length for Telegram, but even the alerts with small message are getting skipped.

Thanks

#2

Hi
I have the exact same problem.
Running Grafana 7.3.1 in Docker
I have setup both Telegram and Discord (without image integration) alerters
When firing the TEST button they are both good:

t=2020-11-01T12:22:08+0000 lvl=info msg="Sending telegram notification" logger=alerting.notifier.telegram chat_id=XXXXXX bot_token=XXXXXXX apiAction=sendMessage
t=2020-11-01T12:22:29+0000 lvl=info msg="Sending alert notification to" logger=alerting.notifier.discord webhook_url=https://discordapp.com/api/webhooks/XXXXXX/XXXXXX

But when the real alarms occurs, no message is sent:

t=2020-11-01T13:00:01+0000 lvl=info msg="New state change" logger=alerting.resultHandler ruleId=4 newState=ok prev state=alerting
t=2020-11-01T13:00:01+0000 lvl=info msg="Sending telegram notification" logger=alerting.notifier.telegram chat_id=XXXXX bot_token=XXXXX apiAction=sendMessage
t=2020-11-01T13:00:01+0000 lvl=eror msg="Failed to send webhook" logger=alerting.notifier.telegram error="Webhook response status 400 Bad Request" webhook="Telegram (no image)"
t=2020-11-01T13:00:01+0000 lvl=eror msg="failed to send notification" logger=alerting.notifier uid=xxxxxx error="Webhook response status 400 Bad Request"
t=2020-11-01T13:00:01+0000 lvl=eror msg="failed to send notification" logger=alerting.notifier uid=xxxxx error="Webhook response status 400 Bad Request"

Can you find similar logs ?

Regards

#3

I realised that I had enabled reminders for mail notification channel & not telegram channel, that is why I was getting too many reminders on mail that looked like genuine alerts. Managed to get both in sync after I disabled reminders :slight_smile: