NSX Upgrade Hangs at 'Verifying Uploaded File' After Upgrade Bundle is Attached

Products

• VMware NSX for vSphere

Issue/Introduction

Symptoms:
When attempting to upgrade an NSX Manager, the NSX Manager verifies the uploaded file indefinitely after the upgrade bundle is attached to the NSX Manager. In the VSM.LOG, error messages can be seen regarding hosts missing from inventory similar to the following:

2019-02-01 19:09:34.535 GMT ERROR HostStatusServiceInitThread FabricDeployerImpl:471 - - [nsxv@6876 comp="nsx-manager" subcomp="manager"] Resource host-1414 not found in inventory
2019-02-01 19:09:34.535 GMT  WARN HostStatusServiceInitThread HostStatusServiceImpl:142 - - [nsxv@6876 comp="nsx-manager" subcomp="manager"] Failed to get initial host ID list from Network Preparation Service: null

An error message is also visible on the NSX dashboard in the 'Fabric Status' widget.  The error will report "Failed to get data for 'Host Preparation Status, Host Communication Channel Status': Aggregate Count Widget LabelValueConfiguration_HostCommunicationStatus has an invalid number null.  Only numbers are allowed as fields for aggregrate_count sub-type".

Environment

VMware NSX for vSphere 6.4.x
VMware NSX for vSphere 6.3.x

Cause

A stale host entry resides in the nwfabric_resource_status_feature_status table of the NSX Manager database.

Resolution

This is a known issue affecting VMware NSX Data Center for vSphere

Workaround:
If you are unable to upgrade, contact Broadcom Support for assistance if you see the above symptoms.