Change update strategy of CoreOS machine
CoreOS uses a tool called locksmith to coordinate reboots across the cluster. You can use this tool to temporarily prevent reboots by jumping onto a machine and running locksmithctl lock, which will indicate to the cluster that a machine has already taken the reboot slot and will keep it occupied until you run locksmithctl unlock.
Your best bet however, is to edit the cloud-config.