502 error adding data source (prometheus)

Hi All,

Grafana Version - 6.0.0

I used the helm chart to install Grafana & prometheus on Azure Kubernetes Cluster

When I try to add the prometheus as a data source it gives me a Bad Gateway error as bellow.

2019/03/17 06:07:12 http: proxy error: dial tcp 10.0.226.40:9090: i/o timeout
t=2019-03-17T06:07:12+0000 lvl=info msg=“Request Completed” logger=context userId=1 orgId=1 uname=admin method=GET path=/api/datasources/proxy/1/api/v1/query status=502 remote_addr=127.0.0.1 time_ms=30001 size=0 referer=http://grafana.staged-by-discourse.com/datasources/edit/1/

10.0.226.40 is the IP of the prometheus service. some suggest to add the IP of the prometheus pod but if the pod is rescheduled or created IP would change. So I dont think its the best solution

Thanks