Jumbo Frames, ISCSI and ESXi

I have enabled Jumbo Frames (9000) in ESXi for all my vmNICs, vmKernels, vSwitches, iSCSI Bindings etc - basically anywhere in ESXi where it has an MTU settings I have put 9000 in it. The ports on the switches (Dell PowerConnects) are all set for Jumbo Frames. I have a Dell MD3200i with 2 controllers, each with 4 ports for iSCSI. Each of these ports is set to Jumbo Frames (9000) as well.

So now the questions:

1. Do I need to log into each Windows Server VM I am running and delve into the NIC properties and manually set it to Jumbo Frames in the NIC properties in the device Manager as well?
2. Whats the best way of testing that Jumbo Frames are indeed working as intended?

Solution 1:

Don't do this unless you know exactly what you're doing. Really only do it on your dedicated iSCSI NICs and connected switch ports and SAN NICs.

There's really not many reasons to have non-storage ports set for Jumbo Frames with modern equipment.

Solution 2:

In order to test if jumbo frames are working correctly:

1. Enable SSH into the ESXi host and login to the shell(VmWare KB)
2. Do a ping of a storage IP using the don't-fragment option and using a packet size higher than 1500, ex: vmkping -d -s 7000 storageipaddr

If you receive something like:

~ # vmkping -d -s 7000 10.10.10.10
PING 10.10.10.10 (10.10.10.10): 7000 data bytes
sendto() failed (Message too long)
sendto() failed (Message too long)
sendto() failed (Message too long)

--- 10.10.10.10 ping statistics ---
3 packets transmitted, 0 packets received, 100% packet loss

It means that there is an issue with your configuration, Jumbo frames are not working! You should follow this doc to see if all of your virtual switches have proper MTU size.