Virtual machine experiences high I/O wait time and high CPU utilization

Products

• VMware vSphere ESXi

Issue/Introduction

Symptoms:

• Virtual machines may experience high I/O wait time and high CPU utilization
• vmx logs for the virtual machine may report aborts:

2025-06-11T03:23:43.611Z In(05) vcpu-8 - PVSCSI: scsi0:0: aborting cmd 0x36e
2025-06-11T03:23:43.811Z In(05) vcpu-8 - PVSCSI: scsi0:0: aborting cmd 0x398
2025-06-11T03:48:09.082Z In(05) vcpu-8 - PVSCSI: scsi0:2: aborting cmd 0x338
2025-06-11T03:53:00.920Z In(05) vcpu-8 - PVSCSI: scsi0:1: aborting cmd 0x352

Environment

VMware vSphere ESXi

Cause

• The issue is caused when there are dropped frames in the fabric
• VMkernel logs may report the below errors and BUS_BUSY messages for read and write commands:

Dropped frame(s) detected (374784 of 524288 bytes).
2025-06-11T03:49:41.096Z In(182) vmkernel: cpu1:2100909)qlnativefc: vmhba1(3a:0.1): qlnativefcStatusEntry:2067:C0:T10:L11 - FCP command status: 0x15-0x0 (0x2) portid=750321 oxid=0x64d cdb=28009c len=524288 rspInfo=0x0 resid=0x0 fwResid=0x5b800 host status = 0x2 device st$
2025-06-11T03:49:41.096Z In(182) vmkernel: cpu78:2098462)NMP: nmp_ThrottleLogForDevice:3893: Cmd 0x28 (0x45ea9832ea80, 2398029) to dev "naa.600################" on path "vmhba1:C0:T10:L11" Failed:
2025-06-11T03:49:41.096Z In(182) vmkernel: cpu78:2098462)NMP: nmp_ThrottleLogForDevice:3898: H:0x2 D:0x0 P:0x0 . Act:EVAL. cmdId.initiator=0x430fe4237480 CmdSN 0x3d1
2025-06-11T03:49:41.096Z Wa(180) vmkwarning: cpu78:2098462)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:235: NMP device "naa.600############" state in doubt; requested fast path state update...

Resolution

• This issue is outside the scope of VCF or vSphere
• Please contact the storage and the fabric vendor to further investigate the issue