Hey there, answering my own question here.
I looked through the integration and the metrics it lists out are the defaults for when you have it generate the grafana-agent.yaml snippets for you. That happens in the metric_relabel_configs, action: keep section, which is a big long regex “or” of the metrics that will be taken from the collector and put into prometheus.
So I added the new new metrics I wanted by appending to that regex: |node_hwmon_temp_celsius|node_cpu_scaling_frequency_hertz
I restarted the agent, and was quickly able to use those metrics in my dashboards.
Hope that helps!