Unable to add disk to vSAN disk group post replacing defective capacity disk

Products

• VMware vSAN

Issue/Introduction

Symptoms:

Unable to add disk to disk group post replacing defective capacity disk.

Validation: 

• Disk group creation failed with the following error:

A general system error occurred: AIO zero write failure to device /vmfs/devices/disks/naa.################ exception AIO write failure for device naa.################

 

• Device statistics may indicate failed read/write operations.

  • On an SSH session on the ESXi host, run this command, and look at the disk in question:

esxcli storage core device stats get

naa..################ :
   Device: naa..################
   Successful Commands: 14329051969
   Blocks Read: 97463258079
   Blocks Written: 64638172860
   Read Operations: 7671279104
   Write Operations: 6657139224
   Reserve Operations: 20
   Reservation Conflicts: 0
   Failed Commands: 304997
   Failed Blocks Read: 620931
   Failed Blocks Written: 37770
   Failed Read Operations: 134858
   Failed Write Operations: 144994
   Failed Reserve Operations: 0

 

Environment

VMware vSAN 7.x

VMware vSAN 8.x

 

Cause

The replacement disk that was added to the system may also be faulty, as it failed to initialize correctly.

Alternatively, this could indicate a problem with the hardware slot the disk is plugged into, as there have now been two "failed" disks in the same slot.

Resolution

Engage hardware vendor to investigate the failed disk messages.