ESXi fails with PSOD Panic Message: @BlueScreen: NMI IPI: Panic requested by another PCPU. RIPOFF(base)

Products

• VMware vSphere ESXi

Issue/Introduction

Symptoms:

• ESXI Host crashed suddenly with a PSOD.
• vmkernel core dump vmkernel are sometimes found in the /var/core directory
• From the backtrace
  cpu34:5421077)qlnativefc: vmhba5(ac:0.0): qla27xxCopyFpinPkt:11883:SCM: Ran out of IOCBs, partial data 0x14
cpu34:5421077)qlnativefc: vmhba5(ac:0.0): qla27xxCopyFpinPkt:11883:SCM: Ran out of IOCBs, partial data 0x14
2024-10-15T06:27:25.720Z cpu34:5421077)qlnativefc: vmhba5(ac:0.0): qla27xxCopyFpinPkt:11883:SCM: Ran out of IOCBs, partial data 0x14
cpu34:5421077)qlnativefc: vmhba5(ac:0.0): qla27xxCopyFpinPkt:11883:SCM: Ran out of IOCBs, partial data 0x14
ESC[7m2024-10-15T06:27:25.720Z cpu48:5025914)WARNING: Lock: 1707: Sending NMI to cpu 34.ESC[0m
cpu34:5421077)qlnativefc: vmhba5(ac:0.0): qla27xxCopyFpinPkt:11883:SCM: Ran out of IOCBs, partial data 0x14
cpu34:5421077)qlnativefc: vmhba5(ac:0.0): qla27xxCopyFpinPkt:11883:SCM: Ran out of IOCBs, partial data 0x14
cpu34:5421077)qlnativefc: vmhba5(ac:0.0): qla27xxCopyFpinPkt:11883:SCM: Ran out of IOCBs, partial data 0x14
cpu34:5421077)NMI: 616: 0xfffffffffc407e38:[0xfffffffffc067ae2] (vmm64)

cpu34:5421077)NMI: 616: 0x0:[0xfffffffffc067ec1]
qla27xxCopyFpinPkt@(qlnativefc)
qla24xxProcessResponseQueue@(qlnativefc)
qla24xxMsixRspQ@(qlnativefc)

Environment

VMware ESXi 8.0.x

Cause

The firmware (Firmware Version: 9.12.00 (d0d5)) is not compatible with the driver (qlnativefc  5.4.81.2- OEM.800.1.0.20613240).

 

Resolution

Please do engage with the hardware vendor for driver compatibility as VMware do not manufacture drivers.