USB flash drive in ExFat doesn't unmount

Solution 1:

Force-quit Disk Utility and yank the drive. OS X will probably fuss at you; ignore it.

Stick the drive into the Windows computer and format it there, using Disk Management. (I've had much better success with ExFAT drives formatted under Windows than under OS X.)