Reverse proxy config breaks localhost or 127.0.0.1 access

So, I’ve (somewhat) successfully configured Grafana to work with a reverse proxy. While I now can access Grafana through the reverse proxy, I can no longer access Grafana directly (via localhost, 127.0.0.1, etc.) - I get the {{alert.title}} error.

Here’s my [server] portion from my custom.ini:

[server]
# Protocol (http, https, socket)
protocol = http

# The ip address to bind to, empty will bind to all interfaces
http_addr = 

# The http port  to use
http_port = 9000

# The public facing domain name used to access grafana from a browser
domain = mydomain.com

# The full public facing url you use in browser, used for redirects and emails
# If you use reverse proxy and sub path specify full url (with sub path)
root_url = %(protocol)s://%(domain)s:/grafana

When I visit http://localhost:9000 it successfully redirects to http://localhost:9000/grafana/login but that page returns a 404. I’ve clear the browser cache, tried localhost, 127.0.0.1, etc. and nothing seems to get local access working again. When I comment out the root_url setting, local access works again, but it obviously breaks the reverse proxy.

Any ideas? Thanks!