SDDC Manager 9.0.x Fails to Sync or Detect Out of Band NSX Manager Nodes Added via NSX GUI

Products

• VMware SDDC Manager

Issue/Introduction

• During SDDC domain deployment, one NSX manager node was deployed for the NSX manager cluster.
• Post the domain deployment, two additional NSX manager where deployed Out of Band (OOB) in NSX, to form a three node NSX manager cluster.
• NSX cli command 'get cluster status' shows a healthy three nodes cluster.
• SDDC manager API 'GET /v1/nsxt-clusters' shows the cluster with only one node.

Environment

SDDC Manager 9.0.x

Cause

In the current version of VCF SDDC manager 9.0.x, the scale out operations performed inside NSX are not synced back to the SDDC manager. This is planned for a future release.

Resolution

Note: To ensure inventory synchronization, NSX Manager scale out must be performed exclusively via SDDC Manager; Broadcom is currently updating technical documentation to formalize this limitation.

Make sure you have an NSX and SDDC backup, prior to following the steps below.

Step 1 - Deactivate the existing NSX Manager Cluster

1. SSH as admin user to the NSX manager which was deployed from the SDDC manager, not either of the two OOB deployed NSX managers.
2. Run the command deactivate cluster
3. Power off and delete the two NSX Managers deployed OOB from vCenter.
   • ONLY POWER OFF AND DELETE THE NSX MANGERS DEPLOYED OOB

Step 2 - Scaling out the NSX Manager Cluster via SDDC API (Use the GUI or CLI API)

Procedure to Scale Out NSX Manager Nodes via SDDC Manager API:

1. 1. Log in to the SDDC Manager UI.

   2. Navigate to the Developer Center via the home dashboard or sidebar.

   3. Select the API Categories

      1. NSX-T Cluster

GET /v1/nsxt-clusters

• • • • Copy the UUID of the NSX-T that needs to scale out.

1. 1. Locate the NSX-T Clusters section and select scale-out endpoint as below:

      1. NSX-T Cluster

      2. POST /v1/nsxt-clusters/{nsxt-cluster-id}/scale-out

         1. Paste the nsxt-cluster-id

         2. *EXAMPLE* In the request body field, enter YOUR NODE DETAILS the following JSON payload:
            {
              "nsxManagerSpecs": [
                {
                  "name": "<NAME>",
                  "networkDetailsSpec": {
                    "ipAddress": "192.168.1.###",
                    "dnsName": "<FQDN>",
                    "gateway": "192.168.1.###",
                    "subnetMask": "255.255.255.0"
                  }
                },
                {
                  "name": "<NAME>",
                  "networkDetailsSpec": {
                    "ipAddress": "192.168.1.###",
                    "dnsName": "<FQDN>",
                    "gateway": "192.168.1.###",
                    "subnetMask": "255.255.255.0"
                  }
                }
              ]
            }

Click Execute

Note: Above, replace FQDN, NAME and IP addressing with the correct values for the two additional NSX manager node to add to the NSX manager cluster.

 

Post-validation (Full Synchronization may take up to an hour.)

1. SDDC Manager UI
   1. NSX shows as healthy
      • Inventory now reflects 3 NSX Managers
   2. NSX UI
      • System > Appliances: 3 managers, stable cluster

Additional Information

Refer to API guide: Scale Out Nsx