check what Elasticsearch returns, maybe it is not returning what you think, it probably returns 2 values, one very low and one for the whole day, which explains the low avg.
Upgrade to v5 and you can use the query inspector to investigate what the query is sending to ES and what it is returning, Using Grafana's Query Inspector to troubleshoot issues