ESXi fails with PSOD Panic Message: @BlueScreen: NMI IPI: Panic requested by another PCPU. RIPOFF(base)

Products

• VMware vSphere ESXi

Issue/Introduction

• ESXI Host crashed suddenly with a PSOD.
• If available vmkernel core dump vmkernel are found in the /var/core
• From the backtrace
  

  cpu34:5421077)qlnativefc: vmhba5(ac:0.0): qla27xxCopyFpinPkt:11883:SCM: Ran out of IOCBs, partial data 0x14
  cpu34:5421077)qlnativefc: vmhba5(ac:0.0): qla27xxCopyFpinPkt:11883:SCM: Ran out of IOCBs, partial data 0x14
  2024-10-15T06:27:25.720Z cpu34:5421077)qlnativefc: vmhba5(ac:0.0): qla27xxCopyFpinPkt:11883:SCM: Ran out of IOCBs, partial data 0x14
  cpu34:5421077)qlnativefc: vmhba5(ac:0.0): qla27xxCopyFpinPkt:11883:SCM: Ran out of IOCBs, partial data 0x14
  ESC[7m2024-10-15T06:27:25.720Z cpu48:5025914)WARNING: Lock: 1707: Sending NMI to cpu 34.ESC[0m
  cpu34:5421077)qlnativefc: vmhba5(ac:0.0): qla27xxCopyFpinPkt:11883:SCM: Ran out of IOCBs, partial data 0x14
  cpu34:5421077)qlnativefc: vmhba5(ac:0.0): qla27xxCopyFpinPkt:11883:SCM: Ran out of IOCBs, partial data 0x14
  cpu34:5421077)qlnativefc: vmhba5(ac:0.0): qla27xxCopyFpinPkt:11883:SCM: Ran out of IOCBs, partial data 0x14
  cpu34:5421077)NMI: 616: 0xfffffffffc407e38:[0xfffffffffc067ae2] (vmm64)
  
  cpu34:5421077)NMI: 616: 0x0:[0xfffffffffc067ec1]
  qla27xxCopyFpinPkt@(qlnativefc)
  qla24xxProcessResponseQueue@(qlnativefc)
  qla24xxMsixRspQ@(qlnativefc)

Environment

VMware vSphere ESXi 8.X

Cause

• The firmware version: 9.15.00 is not compatible with the driver qlnativefc 5.4.80.0
• Read more at ESXi Purple Screen Due to QLogic/Marvell HBA Driver Deadlock

Resolution

• Upgrade driver to version 5.4.82.1-1OEM 
• 
• Read more at COMPATIBILITY GUIDE
• Engage with Hardware vendor to check for any further compatibilities