vLCM managed NSX host upgrade failed via SDDC Manager due to insufficient disk space in /tmp

Products

• VMware NSX

Issue/Introduction

• In SDDC manager UI, upgrade NSX host task failed with an error.

Error:  Check for errors in the LCM log files at 127.0.0.1:/var/log/vmware/vcf/lcm, and address those errors. Check if the SDDC Manager is able to communicate with NSX Manager. If not, login to NSX and check if upgrade is running and wait for the completion. Please run the upgrade precheck and restart the upgrade.

• NSX manager upgrade-coordinator.log shows insufficient disk space.

"default_message":"Disk space requirements not met. Please ensure 180MB free space is available in tmp partition to proceed with upgrade."

• ESXi nsx-syslog.log shows vdf commands executed confirmed the partition was short of the requirement.

Running command vdf -p | grep '^tmp ' | sed 's/ \+/ /g' | awk '{print $3, $6}'.
Command ... succeeded (xxxxxx ).   <-----Less than required 180MB.

 

Environment

VMware Cloud Foundation (VCF) 5.x

Cause

The ESXi /tmp RAM disk partition lacked the mandatory 180MB of free space required for the NSX/host upgrade process.

Resolution

1. Log in to the affected ESXi host via SSH.
2. Reboot the ESXi host to clear the RAM-based /tmp partition.
3. Alternatively, manually clear the partition following KB 413259.
4. Re-run the upgrade precheck and restart the upgrade in SDDC Manager.