ESXi 5.5, slow network speed when writing to guests

This is an issue that has been bugging me for a lot time with ESXi. I had the issue with my old Dell server (ESXi 5.0 and 5.5) and even with my new Dell T20 (ESXi 5.5). For the current issue at hand I will only focus on the new Dell T20 server, to avoid confusion.

Whenever I try to upload something from my Windows 7 PC to any VM on the servers, I don't get more than 3-5 MB/s. No matter if I use Samba, SFTP, FTP or uploading ISOs with the vSphere client. When I copy a file FROM the VMs to my Windows 7 PC, I will get speeds of around 70-90 MB/s which looks fine to me.

I will list a few infos that I think may be helpful to determine the issue.

  • ESXi 5.5 U1 (#1623387)
  • Intel 82571 NIC (Gigabit)
  • 1 TB HDD (no RAID), ESXi & VM's are on this HDD
  • VMware Tools are installed and up-to-date
  • VMXNET3 NIC for the VMs
  • The management network is on the same physical NIC since I only have one
  • 2 active VMs running, but idling (Windows XP and Ubuntu 12.04)
  • Windows 7 is my current PC and not a VM
  • Using 3rd party NIC driver net-e1000e-2.3.2.x86_64.vib from >here<

iperf speed test over 30 seconds (using 2.0.5 on Ubuntu and JPerf 2.0.2 on Windows):

Windows 7 Client - Ubuntu 12.04 Server: 1270 MBytes = 355 Mbits/sec

Windows 7 Server - Ubuntu 12.04 Client: 2.29 GBytes = 655 Mbits/sec

Windows XP Server - Ubuntu 12.04 Client: 7314 MBytes = 2045 Mbits/sec

Windows XP Client - Ubuntu 12.04 Host: 744 MBytes = 623 Mbits/sec

Graphs here: Link

If there's anything else you need to know, please let me know.


Solution 1:

Your network card uses the Intel igb driver. Under VMware and Linux, that device/driver can be troublesome. I'd try the following:

  • Your ESXi build number is 1331820 and includes version 4.2.16.8 of the igb NIC driver. The current ESXi build has version 5.0.5.1.1 of the igb driver. An update of ESXi may be appropriate.

  • The defaults on the igb driver don't perform well for certain workloads. Take a look at this VMware Knowledge Base article for guidance on the correct turntables for that card.

In a virtual environment, for certain workloads and (or) configurations, the network performance achieved on an Intel 1Gbps NIC using the igb driver might be low because the interrupt throttling rate for the igb driver is not optimal for that workload. The network Bandwidth of Intel 82576 and Intel i340T4/i350 do not go up to the supported 1 Gb/s It performs slower than other 1Gb/s cards