Dell NVMe PS1010 and PS1030 with firmware version 1.0.0 may see a PCIe bus fatal error and PSOD
search cancel

Dell NVMe PS1010 and PS1030 with firmware version 1.0.0 may see a PCIe bus fatal error and PSOD

book

Article ID: 388246

calendar_today

Updated On:

Products

VMware vSAN 7.x VMware vSAN 8.x

Issue/Introduction

Dell NVMe  PS1010 and PS1030 NVMe SSD drives with firmware version 1.0.0 may see a PCIe bus fatal error and PSOD.

This condition may be seen in production while the drives are under a heavy I/O workload. It may also be seen in some scenarios when a vm-support is gathered.

We have also seen Drive Failures on several vSAN hosts at the same time and Failed Disk Group due to this issue.

Environment

VMware vSAN 7.x
VMware vSAN 8.x (OSA and ESA) 

Cause

The PS1010 and PS1030 NVMe drives may see this error due to internal drive tasks being delayed and not completed within a determined timeframe.

Resolution

Update the PS1010/PS1030 NVMe SSD to firmware version 1.2.0 or later; the firmware update package is compatible with both drive models.
Dell Express Flash NVMe PS10x0 ISE PCIe SSD Firmware


NOTE: Upgrading the PS1010/PS1030 drives from firmware version 1.0.0 to any higher version requires a system power cycle. The drive displays the updated firmware in the iDRAC UI and OS utilities but may continue to experience PCIe errors until a power cycle is completed.

To accomplish this step, power the system down fully and then power it back on after the firmware update has been applied.

Additional Information