vCenter is down and can't manage ESX and VMs

Products

• VMware vSphere ESXi

Issue/Introduction

Symptoms

• Host got disconnected from VC
• vCenter and Host UI was not accessible 

Environment

VMware vSphere ESXi

Cause

The Datastore on which the vCenter was hosted was created n thin provisioned LUN. The Pool on which the LUN was created experiencing the Space issue. 

Verification Steps: 

• /var/run/log/vmkernel.log shows 0x7 0x27 0x7 i.e. Thin Provisioned pool out of space, indicating the storage is out of space 

2025-04-16T03:41:45.813Z cpu4:2097752) ScsiDeviceIO: 4167: Cmd (0x45c069fb8048) 0xfe, CmdSN 0x31d617 from world 2097792 to dev "naa. 600a098038314770312b53646b48447a" failed H: 0x0 D: 0x2 P: 0x8 Valid sense data: 0x7 0x27 0x7

• Used Capacity from Storage console (Vendor Provided)

Resolution

Following KBs talks about the issue on details. 

Error "THINPROV_NOSPACE: Backing pool for thin-provisioned LUN is out of space"

VMs freeze due to out of space issue with thin-provisioned LUNs