Permanent disk failure in vSAN

Products

• VMware vSphere ESXi

Issue/Introduction

Symptoms:

• In vCenter UI, the Skyline health (vSAN cluster > Monitor > vSAN > Skyline Health > Physical Disk > Operation health) may report permanent disk failure for the vSAN disk as in the figure below:

 

• /var/log/vobd.log of ESXi host will also report the disk is under permanent error:

025-02-04T15:47:46.212Z:[vSANCorrelator] 12219239351514u3:[esx.problem. vob. vsan.pdl. offline] vSAN device ########-####-####-####-########### has gone offline.
025-02-04T15:47:46.212Z:[vSANCorrelator] 12219239351514u3:[esx.problem. vob. vsan. lsom. devicerepair] Device e ########-####-####-####-########### is in offline state and is getting repaired.
025-02-04T15:47:46.212Z:[vSANCorrelator] 12219239351514u3:[vob.vsan.pdl.offline] vSAN device e ########-####-####-####-########### has gone offline.
025-02-04T15:47:46.212Z:[vSANCorrelator] 12219239351514u3:[esx.problem. vob.vsan.pdl.offline] vSAN device e ########-####-####-####-########### has gone offline.
025-02-04T15:47:46.212Z:[vSANCorrelator] 12219239351514u3:[vob. vsan.lsom. diskerror] vSAN device e ########-####-####-####-########### is under permanent error.

Environment

VMware vSAN 7.x
VMware vSAN 8.x

Cause

This is caused due to hard disk issue.

vSAN will mark a disk offline when it encounters I/O failure, preventing further operations on the affected disk.

Resolution

To resolve this issue, refer to this article How to troubleshoot vSAN OSA disk issues

The above article provides a guide on troubleshooting vSAN OSA disk issues, including diagnosing disk failures, checking disk status, and performing actions like host rebooting or disk replacement to resolve problems.