PSOD occurs during reboot of ESXI host

Products

• VMware vSphere ESXi

Issue/Introduction

Rebooting the host from the vCenter UI, ESXI UI or CLI, the host has a PSOD.

However rebooting the host from the Cisco UCS manager,  does not trigger the PSOD. Applied all power options and no PSOD occurred (power off, power cycle, reset).

The following backtrace is observed: 

YYYY-MM-DDTHH:MM:SS cpux:2097588)vmd_DetachDevice: vmd:x
YYYY-MM-DDTHH:MM:SS cpux:2097588)vmd_DisableInterrupts
......
YYYY-MM-DDTHH:MM:SS cpux:2097588)Device: 461: psa:driver->ops.detachDevice:0 ms
.....
YYYY-MM-DDTHH:MM:SS cpux:2097588)bcm_mpi3_0000:63:00.0: mpi3_issue_mur: 332: Initiating MUR becuase of Detach Device
.....
YYYY-MM-DDTHH:MM:SS cpuxx:2098349)0x453a22d1bf20:[0x420033950207]hp_HandleIrq@(iavmd)#<None>+0x93 stack: 0x36
YYYY-MM-DDTHH:MM:SS cpuxx:2098349)0x453a22d1bf50:[0x420032a2c6eb]VmkTimerQueueWorldFunc@vmkernel#nover+0x258 stack: 0x5415431a48a02fa0
YYYY-MM-DDTHH:MM:SS cpuxx:2098349)0x453a22d1bfe0:[0x420032db4ead]CpuSched_StartWorld@vmkernel#nover+0x86 stack: 0x0
YYYY-MM-DDTHH:MM:SS cpuxx:2098349)0x453a22d1c000:[0x420032ac4fff]Debug_IsInitialized@vmkernel#nover+0xc stack: 0x0

Environment

ESXI 7.0.3

Resolution

Upgrade the async Intel driver iavmd-3.2.0.1008-1OEM.700.1.0.15843807 to the latest version.

Upgrading the driver can be done using vLCM for reference: 

https://techdocs.broadcom.com/us/en/vmware-cis/vsphere/vsphere/8-0/managing-host-and-cluster-lifecycle-8-0/using-images-to-install-and-update-esxi-hosts-and-clusters/firmware-updates.html