Grafana (Prometheus and Loki) selfmonitoring how to

Hi,

I am currently building a monitoring environment with Grafana, Prometheus and Loki (latest versions). Is there a selfmonitoring how to or a best pratice guide about which metrics of Grafana, Prometheus and Loki are important to monitor? Which internal metrics should I keep an eye on?

thanks a lot
Frank

Grafana exposes a prometheus endpoint at /metrics. I think prometheus has the same endpoint, which this dashboard uses:

Loki has the same:

It would be awesome to see someone build a self-monitoring tutorial that walked through all of the services