Random and Selective ARP blindness in VMWare ESXi 4.1
Solution 1:
This sounds like you just might have a MAC-collision on your hands. The fact that the two boxes are swapping is what suggests it to me. Something in the vSwitch layer may be forwarding packets incorrectly.