Low I/O performance using intel-nvme drivers 1.3.2.8-1OEM and 1.3.2.4-1OEM with block sizes larger than 4K.

Products

• VMware vSphere ESXi

Issue/Introduction

Symptoms:

• Significant performance degradation is observed when I/O block size is greater than 4K.
• 4K block size IOPS are not affected.

Environment

VMware vSphere ESXi 6.x

Resolution

• This issue is resolved in intel-nvme driver version 1.4.0.1016-1OEM for ESXi 6.5 and 6.7. 
• Steps to download the driver : Finding IO Drivers in the Broadcom Support Portal
• To check the current version of driver, run esxcli software vib list | less intel-nvme
• Steps to install the driver refer: Download and install async drivers in VMware ESXi

Workaround:

• To workaround this issue downgrade the driver to the intel-nvme driver 1.2.1.15-1OEM on ESXi 6.5 and ESXi 6.7.
• On ESXi 6.0, use 1.2.0.9-1OEM.
• Run the below command to downgrade the driver:
  • Upload the driver to /tmp and execute the following command from the SSH: ​esxcli software vib install --force --no-sig-check --maintenance-mode --viburl=file:/tmp/intel-nvme-1.2.1.15-1OEM.<rest of driver name>.vib

Note: For ESXi 6.0 use the VIB file: intel-nvme 1.2.0.9-1OEM

• A host reboot is required to activate the driver.

Note: ESXi 7.0 is unaffected by this issue.

Additional Information

Impact/Risks: Requires reboot of ESXi host.