VMware NSX Edge upgrades fail due to mount exception: <mount point> already mounted or mount point busy

Products

• VMware NSX

Issue/Introduction

Symptoms:

• VMware NSX Edge upgrade fails with a message similar to the following in the VMware NSX Edge Upgrade UI:

install_os execution failed with msg: An unexpected exception occurred: CommandFailedError: Command ['mount', '-o', 'ro', '/dev/mapper/nsx-config', '/tmp/tmpd6fpw2yr'] returned non-zero code 32: b'mount: /tmp/tmpd6fpw2yr: /dev/mapper/nsx-config already mounted or mount point busy.\n

• In the edge node syslog we see:

nsx-edge-0-1 NSX 3081986 SYSTEM [nsx@6876 comp="nsx-edge" subcomp="upgrade-bundle" level="INFO"] Unmounting /config
nsx-edge-0-1 systemd 1174061 - - config.mount: Succeeded.
nsx-edge-0-1 systemd 1 - - config.mount: Succeeded.
nsx-edge-0-1 NSX 3081986 SYSTEM [nsx@6876 comp="nsx-edge" subcomp="upgrade-bundle" level="INFO"] Mounting /dev/mapper/nsx-config partition as ro on /tmp/tmpd6fpw2yr directory
nsx-edge-0-1 NSX 3081986 SYSTEM [nsx@6876 comp="nsx-edge" subcomp="upgrade-bundle" level="INFO"] Output of mounting /dev/mapper/nsx-config as ro on /tmp/tmpd6fpw2yr directory: mount: /tmp/tmpd6fpw2yr: /dev/mapper/nsx-config already mounted or mount point busy.

Note: The /tmp/tmpd6fpw2yr details above may be different in your environment.

Environment

VMware NSX-T Data Center

Cause

The issue occurs as there are open references to the config partition after it has been unmounted during the upgrade process.

Resolution

This is a condition that may occur in a VMware NSX environment.

Workaround:
Reboot the Edge that failed to upgrade and then resume the upgrade process.
This will clear the open references, allowing the upgrade process to continue.