/storage/core runs out of space due to core.vsanvcmgmtd on vCenter Server

Products

• VMware vCenter Server
• VMware vSAN

Issue/Introduction

To ensure /storage/core on the VC doesn't get filled up and proper workaround and resolution is provided to resolve this issue.

Symptoms:

• After upgrading Vxrail to version 7.0.000-16050759 /storage/core is getting full in 15 min with file "core.vsanvcmgmtd" and VC is down.

/dev/mapper/core_vg-core 542G 542G 0 100% /storage/core.

• Log collection fails from UI, appliance management and CLI.

    /storage/core partition full with core.vsanvcmgmtd logs

• Rebooting vCenter and VxRail ESXi Hosts made no difference.

• Analyzing the core file using debug-vc-core shows references to VsanCloudHealthJsonUtil.py

Environment

VMware vCenter Server 7.0.x

VMware vSAN 7.0.x

Cause

• This is caused due  to stack overflow caused by VmodlToJsonForPhoneHome.

Resolution

This issue is resolved in vSphere vCenter Server 7.0 U1 and later builds.

If further assistance needed or any questions around this, please contact Broadcom Support.