Apps are rearranged when multiple monitors wake from sleep or power on

Solution 1:

Looks like this is a known bug: https://bugs.launchpad.net/ubuntu/+source/mutter/+bug/1927948