vSAN node going into PSOD state due to "CPU machine check error"

Products

• VMware vSAN

Issue/Introduction

Symptom:

• PSOD screen seen on the vSAN node -
  
  
  
  Backtrace:
  0x4539d571bcf0:[0x420026bfe900][email protected]#0.0.0.1+0xac stack: 0x45bd28087d88, 0x420026d45b3d, 0x45bd28087d88, 0x420027130cfe, 0x4339af073488
  0x4539d571bd60:[0x420026df69df][email protected]#0.0.0.1+0x394 stack: 0x3, 0x45bc23a4a610, 0x0, 0x6ee, 0x6ee
  0x4539d571be10:[0x42002713a48d][email protected]#0.0.0.1+0x1a stack: 0x4539d571bf20, 0x45bd28087e18, 0x1000, 0x1, 0x45bd28087d80
  0x4539d571be20:[0x42002712a313][email protected]#0.0.0.1+0x3a8 stack: 0x1000, 0x1, 0x45bd28087d80, 0x1000, 0x44e9b6
  0x4539d571bef0:[0x420027141493][email protected]#0.0.0.1+0x88 stack: 0x7fffffffffffffff, 0x42004b401040, 0x453994e9bc10, 0x4502408414a8, 0x4539d571bf20
  0x4539d571bf80:[0x420027141814][email protected]#0.0.0.1+0x29 stack: 0x4502408414a8, 0x420024b9fecd, 0x74, 0x4200271417ec, 0x420024b9fec8
  0x4539d571bfa0:[0x420024b9fecc]vmkWorldFunc@vmkernel#nover+0x31 stack: 0x420024b9fec8, 0x0, 0x4539d571f000, 0x4539d569f100, 0x4539d571f100
  0x4539d571bfe0:[0x4200250dc88e]CpuSched_StartWorld@vmkernel#nover+0xbf stack: 0x0, 0x420024b453b0, 0x0, 0x0, 0x0
  0x4539d571c000:[0x420024b453af]Debug_IsInitialized@vmkernel#nover+0xc stack: 0x0, 0x0, 0x0, 0x0, 0x0

 

Environment

VMware vSphere vSAN 

Cause

•  PSOD is caused by misbehaving processor or hardware.
  
  Example: # CPU 1 machine check error detected.
  
  Refer - https://www.dell.com/support/kbdoc/en-us/000349127/poweredge-cpu-machine-check-errors?msockid=36879f45b5a06d112e418a8fb40d6cf1 

Resolution

• Engage your hardware vendor to validate the health of the ESXi host, also validate the alerts on the hardware interface.