VMkernel log is flooded with "VSCSI: 590: VSCSI_VmkAccumulateSG failed: Out of memory"

Products

• VMware vSAN
• VMware vSphere ESXi

Issue/Introduction

Symptoms:
VMkernel log is flooding with messages similar to:
 

2021-11-29T18:19:00.309Z cpu20:3491684)WARNING: VSCSI: 1194: Allocate new Cmd, No mem, len=65
2021-11-29T18:19:00.309Z cpu20:3491684)VSCSI: 590: VSCSI_VmkAccumulateSG failed: Out of memory
2021-11-29T18:19:00.311Z cpu17:3491711)WARNING: SCSI: 195: Unable to allocate SCSI_Command (sgLen = 130, RA 0x420001f4997c)
2021-11-29T18:19:00.311Z cpu17:3491711)WARNING: VSCSI: 1194: Allocate new Cmd, No mem, len=65
2021-11-29T18:19:00.311Z cpu17:3491711)VSCSI: 590: VSCSI_VmkAccumulateSG failed: Out of memory
2021-11-29T18:19:00.311Z cpu28:3492285)WARNING: SCSI: 195: Unable to allocate SCSI_Command (sgLen = 130, RA 0x420001f4997c)
2021-11-29T18:19:00.311Z cpu28:3492285)WARNING: VSCSI: 1194: Allocate new Cmd, No mem, len=65
2021-11-29T18:19:00.311Z cpu20:3491684)WARNING: SCSI: 195: Unable to allocate SCSI_Command (sgLen = 130, RA 0x420001f4997c)
2021-11-29T18:19:00.311Z cpu28:3492285)VSCSI: 590: VSCSI_VmkAccumulateSG failed: Out of memory
2021-11-29T18:19:00.311Z cpu20:3491684)WARNING: VSCSI: 1194: Allocate new Cmd, No mem, len=65
2021-11-29T18:19:00.311Z cpu20:3491684)VSCSI: 590: VSCSI_VmkAccumulateSG failed: Out of memory
2021-11-29T18:19:00.311Z cpu20:3491684)WARNING: SCSI: 195: Unable to allocate SCSI_Command (sgLen = 130, RA 0x420001f4997c)

Environment

VMware vSAN 7.0.x
VMware vSphere ESXi 7.x

Cause

When VMkernel runs out of memory, these events are issued for virtual disk IO.

Note: This issue is observed on 7.0 U3c

Resolution

This issue is resolved in vSphere ESXi 7.0 U3f, build 20036589.

Workaround:
A workaround is not available.

Additional Information

Impact/Risks:
The vmkernel.log will become inundated with messages, which might lead to losing other issues and important logs. This may also cause inconsistent data to be written by VMs on the host.