VMs hang after storage controller upgrade

Products

• VMware vSphere ESXi

Issue/Introduction

After a storage controller upgrade when the targets come back up and are expected to be online, VMs became hung and unresponsive.

VMs went offline after path failures to datastores during Storage System Maintenance.

 

Environment

VMware vSphere ESXi 7.0
VMware vSphere ESXi 8.0 

Cause

VMs become hung because the storage devices that are expected to be accessible behind these targets after the upgrade, repeatedly report the following scsi sense code :H:0x0 D:0x2 P:0x0 Valid sense data: 0x2 0x4 0xc.

This scsi sense code translates to Not Ready / LOGICAL UNIT NOT ACCESSIBLE, TARGET PORT IN UNAVAILABLE STATE

ESX: /var/log/vmkernel.log
####-##-##T##:##:##.###Z cpu11:#######)WARNING: NMP: nmpCompleteRetryForPath:364: Retry cmd 0x28 (0x45d9606cef08) to dev "naa.################################" failed on path "vmhba#:C#:T#:L#" H:0x0 D:0x2 P:0x0 Valid sense data: 0x2 0x4 0xc.

Resolution

Please contact your storage vendor to investigate further as to why the storage device/port was not fully accessible at the time.