VCF SDDC Inventory Version Precheck Error After NSX Out of Band Upgrade

Products

• VMware Cloud Foundation

Issue/Introduction

In a VCF environment with Federated NSX, following a local NSX manager out of band upgrade, the SDDC Upgrade Coordinator prechecks fail with federation version compatibility error.

Example:
NSX-T Upgrade Coordinator Checks Failed with errors: Check for federation upgrade compatibility: [NSX Manager cannot be upgraded. Please upgrade 'cci-nsx-gbl-01' site before performing upgrade of this site., NSX Manager cannot be upgraded. Please upgrade 'cci-nsx-gbl-02' site before performing upgrade of this site.]: cci-nsx-01c, cci-nsx-01b, cci-nsx-01a

Environment

VMware Cloud Foundation 5.x
VMware Cloud Foundation 4.x
VMware Cloud Foundation 3.x

Cause

When NSXT is upgraded out of band (ie. outside of VCF SDDC), the VCF SDDC does not know that an upgrade has occurred. The SDDC inventory will not be updated, causing this issue. Update the SDDC inventory to reflect the new NSX version.

Resolution

 

For SDDC Manager 5.2 or higher

Follow the steps in KB,  Synchronize inventory versions after out-of-band upgrade in a VMware Cloud Foundation Environment

For SDDC Manager 5.1 or less

1. Login to SDDC manager VM via SSH and sudo to root account.
2. Get VCF deployed NSX-T Cluster Inventory Ids associated with domains with the following api. Note down the "id" (the id of the NSXT cluster) and "version" (current version) fields for each nsxt.

root@sddc-manager [ ~ ]# curl localhost/inventory/nsxt| json_pp

3. For each NSXT id, update the version to the correct version with the following api:

curl localhost/inventory/entities/<<NSX-T ID>> -X PATCH -d '{"type":"NSXT_CLUSTER","status":"ACTIVE","version":"<<VERSION>>"}' -H 'Content-Type:application/json'