I guess there will be up metric for the job, which is collecting those windows metrics. But up metric indicates only if metric scrape was successful or not. It is not real a indicator that VM is down (there can be for example problem with network, … the same problem is with absent), but people are using it for that usually.
You can use it and group by instance and you will have almost desired result.