Host un-responsive post PSOD.

Products

• VMware vSphere ESX 8.x

Issue/Introduction

The host never comes back after the reboot post PSOD. 

Environment

VMware ESXi 8.0 

 

Cause

When there is a high rate of signals being passed to the vmsyslogd, the reload routine becomes stuck, preventing the host from rebooting or responding."

 

#0  NMI_Interrupt (fullFrame=fullFrame@entry=0x452900002f40) at bora/vmkernel/main/nmi.c:855
#1  0x00004200232a0405 in IDTNMIWork (fullFrame=fullFrame@entry=0x452900002f40) at bora/vmkernel/main/x86/idt.c:1773
#2  0x00004200232a186d in Int2_NMI (fullFrame=0x452900002f40) at bora/vmkernel/main/x86/idt.c:1015
#3  0x000042002329b0c7 in gate_entry () at bora/vmkernel/main/x86/gates64.S:175
#4  0x0000420022c90e24 in CPU_StiMwaitInstr (hints=0, extensions=0) at bora/vmkernel/hardware/x86/cpu_int_arch.h:118
#5  Power_ArchPerformWait (args=0x45395f89bb20) at bora/vmkernel/hardware/x86/power.c:455
#6  0x0000420022c90f76 in Power_ArchSetCState (state=<optimized out>, c1type=POWER_CSTATE_MWAIT) at bora/vmkernel/hardware/x86/power.c:366
#7  0x0000420022c7b23f in Power_HaltPCPU (now=<optimized out>, c1type=<optimized out>) at bora/vmkernel/hardware/power.c:870
#8  0x00004200232d4112 in CpuSchedIdleHaltStart () at bora/vmkernel/sched/cpusched.c:15324
#9  CpuSchedIdleLoopInt () at bora/vmkernel/sched/cpusched.c:14587
#10 0x00004200232d863d in CpuSchedBusyWait (mySchedPcpu=0x420040001040) at bora/vmkernel/sched/cpusched.c:15324
#11 CpuSchedTryBusyWait (idleVcpu=0x45394341f100, nowStart=<optimized out>, schedPcpu=0x420040001040) at bora/vmkernel/sched/cpusched.c:9416
#12 CpuSchedChooseAndSwitch (prevIRQL=0 '\000', nhccNow=658006278556, now=<optimized out>, schedPcpu=0x420040001040, prev=<optimized out>) at bora/vmkernel/sched/cpusched.c:9620
#13 CpuSchedDispatch (prevIRQL=<optimized out>, prevState=0) at bora/vmkernel/sched/cpusched.c:9783
#14 0x00004200232d904f in CpuSchedWait (event=..., waitType=<optimized out>, actionWakeupSet=0x0, queue=0x0, cookie=0) at bora/vmkernel/sched/cpusched.c:11364
#15 0x000042002317c1d9 in SCSICompletionWorld (data=0x43095db1e5a0) at bora/vmkernel/storage/midlayer/scsi_adapter.c:1002
#16 0x00004200232d67b3 in CpuSched_StartWorld (destWorld=<optimized out>, previous=<optimized out>) at bora/vmkernel/sched/cpusched.c:15324
#17 0x0000420022d44cf0 in ?? () at bora/vmkernel/main/debug.c:4125
#18 0x0000000000000000 in ?? ()
 

Resolution

Issue is fixed in VMware vSphere ESXi 8.0 Update 3e. 

 

Work Around: 

 

To restart the vmsyslog service. 

esxcli system syslog reload

If Reload of the Service doesn't work you can also try  by killing the service.

pkill vmsyslogd