Looks like this is actually the default behaviour and not related MQTT at all, see link. Quite surprised about that though.