Failed to hot-plug NVMe disk on Server since BIOS does not support

Products

• VMware vSphere ESXi

Issue/Introduction

Symptoms:

• Can not recognize Hot-plug NVMe disk 
• Can not recognize a hot-inserted NVMe disk
• In vmkernel.log, you can find log about "Out of resources"
  

  PCIEHP: 1576: 0000:c8:08.0: hotplug slot:0x8a: num reads=1 slot status=0x48.
  PCIEHP: 1481: 0000:c8:08.0: hotplug slot:0x8a (0000:cc:00.0)Adapter inserted.
  PCIEHP: 1576: 0000:c8:08.0: hotplug slot:0x8a: num reads=1 slot status=0x140.
  PCIEHP: 986: 0000:c8:08.0: Enabling hotplug slot:0x8a
  PCI: 351: probe-scanning pcie bridge @ 0000:c8:08.0 (spawned-bus = cc)
  PCIE: 740: 0000:cc:00.0: PCIe v2 PCI Express Endpoint
  PCI: 1057: 0000:cc:00.0: probing 144d:a900 144d:a906 0108 0200
  PCI: 87: 0000:cc:00.0: Failed to add BAR[0] (MEM64 f=0x4 0x0-0x8000): Limit exceeded
  PCI: 343: 0000:c8:08.0 P2P bridge resources:
  PCI: 345:      IO: 0x0 - 0x0
  PCI: 346:      Mem: 0x0 - 0x0
  PCI: 347:      PrefetchMem: 0x0 - 0x0
  PCI: 351: register-scanning pcie bridge @ 0000:c8:08.0 (spawned-bus = cc)
  PCI: 2633: 0000:cc:00.0: device's MPS is configured to 128 bytes.
  PCI: 1311: 0000:cc:00.0: registering 144d:a900 144d:a906
  PCI: 183: 0000:cc:00.0: Failed to assign BAR[0] (MEM64 f=0x4 0x0-0x8000): Out of resources
  PCI: 343: 0000:c8:08.0 P2P bridge resources:
  PCI: 345:      IO: 0x0 - 0x0
  PCI: 346:      Mem: 0x0 - 0x0
  PCI: 347:      PrefetchMem: 0x0 - 0x0
  PCI: 1317: 0000:cc:00.0 144d:a900 144d:a906 disabled due to insufficient resources or because the device is not supported: Out of resources
  

Environment

VMware vSphere ESXi 8.0.x

Cause

The root port must provision for the MMIO (BIOS setting) requirements of the hot-plug NVMe drives.

Resolution

Check if the server is "PCIe Hot-Plug Ready" certified and Suggest to contact hardware vendor for further diagnosis.