If you query something but minimize/hide it with the eyeball, does alerting still function on that metric?
Nevermind, I hid a bunch of metrics and confirmed that the alerts still seem to be processing correctly.