Change audio output depending on which one is on
Solution 1:
One of the devices needs to be such that Windows can tell if it's on and connected, otherwise the easiest is probably to unplug one. Basically what I used to do when I had TV and speakers plugged in was set the speakers as default, then unplug them when I wanted to use the TV, since the default was not available it should fall back on the next available option.