Select specific day over last X years?

This might not be exactly what you want but have you looked at Time Shifting and Series overrides? It is definitely possible to show these values in different panels with time shifts. Unfortunately InfluxDB has no support for time shift functions yet but maybe in the near future.

http://play.grafana.org/dashboard/db/time-range-override?orgId=1