Adding/Removing a Host on a Cluster with Hostbased VMware NSX SI Deployment
search cancel

Adding/Removing a Host on a Cluster with Hostbased VMware NSX SI Deployment

book

Article ID: 321190

calendar_today

Updated On:

Products

VMware NSX

Issue/Introduction

  • When removing a host from Hostbased SI Deployed Cluster, the NSX Uninstall operation on the ESXi host fails. 
  • Failure can be seen on NSX Manager UI under System > Fabric > Nodes > Host Transport Node.
  • When adding a new host to a Cluster with Hostbased SI Deployment, there is an error for the "Install Agent" task if the ESXi host is on Maintenance Mode.
  • The error can be seen on the vCenter Server User Interface (UI) under "Recent Tasks".
  • If the Cluster is backed by vLCM, the TNP Apply would also fail for the new ESXi host.



Environment

VMware NSX-T Data Center 3.x
VMware NSX-T

Cause

This issue occurs due to the presence of Hostbased SI Deployment on the Cluster (Host-pinned VMs).

Resolution

This issue is resolved in VMware NSX-T Data Center 3.1.3, available at Broadcom downloads.

If you are having difficulty finding and downloading software, please review the Download Broadcom products and software KB.

Select the applicable solution based on the Cluster's Backing (NVDS/CVDS/vLCM).


NVDS-backed Cluster

Removing an ESXi host

  1. Put the ESXi host in Maintenance Mode.
  2. Move the ESXi host to the Datacenter.
  3. Exit Maintenance Mode for the ESXi host in Datacenter and wait for SVM to get deleted (You can see the Deletion Task on vCenter Server UI). Service Deployment status should be Up after this.
  4. Put the ESXi host in Maintenance Mode.
  5. Delete the vmkernel adapters on ESXi host that are connected to any VDS.
  6. Remove the ESXi host from above VDS.
  7. On the ESXi host, Uninstall NSX using this command:

    nsxcli -c del nsx

    For more information, see the article: Uninstall NSX-T Data Center from a vSphere Cluster. Note: After some time, the TN state is shown as "Disconnected" on the NSX UI.
  8. Force Delete TN from NSX.
  9. On the vCenter Server, disconnect the ESXi host and then remove from the inventory.

Adding an ESXi host

  1. Add the ESXi host to the Datacenter.
  2. Add the ESXi host under the necessary VDS Networks.
  3. Move the ESXi host to the Cluster.
  4. Exit Maintenance Mode for the ESXi host. The SVM will be deployed on the ESXi host and the Service Deployment status would turn Up after a successful deployment.

CVDS-backed Cluster

Removing an ESXi host

  1. Put the ESXi host in Maintenance Mode.
  2. Move the ESXi host to the Datacenter.
  3. Exit Maintenance Mode for the ESXi host in Datacenter and wait for SVM to get deleted (You can see the Deletion Task on VC UI). Service Deployment status should be Up after this.
  4. Put the ESXi host in Maintenance Mode.
  5. Delete the vmkernel adapters on ESXi host that are connected to any VDS.
  6. Remove the ESXi host from above VDS.
  7. On the ESXi host, Uninstall NSX using this command:

    nsxcli -c del nsx

    For more information, see the article: Uninstall NSX-T Data Center from a vSphere Cluster.
  8. After the above CLI finishes successfully, remove the ESXi host from the CVDS network. After some time, the TN state is shown as "Disconnected" on the NSX UI.
  9. Force Delete TN from NSX.
  10. On the vCenter Server, Disconnect the ESXi host and then remove from the inventory.

Adding an ESXi host

  1. Add the ESXi host to the Datacenter.
  2. Add the ESXi host under the necessary VDS Networks (optional).
  3. Add the ESXi host under CVDS Network and configure Physical Adapter for the CVDS connection.
  4. Move the ESXi host to the Cluster where the Hostbased SI is deployed. TNP will be applied to the ESXi (can check on NSX UI). Once TNP Apply passes, proceed to the next step.
  5. Exit Maintenance Mode for the ESXi host. SVM will be deployed for the ESX and the Service Deployment status would turn Up after successful deployment.

vLCM-backed Cluster

Removing an ESXi host

  1. Put the ESXi host in Maintenance Mode.
  2. Move the ESXi host to the Datacenter.
  3. Exit Maintenance Mode for the ESXi host in Datacenter and wait for SVM to get deleted (Can see the Deletion Task on VC UI). Service Deployment status should be Up after this.
  4. Put the ESXi host in Maintenance Mode.
  5. Delete the vmkernel adapters on ESXi host that are connected to any VDS.
  6. Remove the ESXi host from above VDS.
  7. On the ESXi host, Uninstall NSX using this command:

    nsxcli -c del nsx

    For more information, see the article: Uninstall NSX-T Data Center from a vSphere Cluster
  8. After the above CLI finishes successfully, remove the ESXi host from the CVDS network. After some time, the TN state is shown as “Disconnected” on the NSX UI.
  9. Force Delete TN from NSX.
  10. On the vCenter Server, Disconnect the ESXi host and then remove from the inventory.

Adding an ESXi host

  1. Add the ESXi host to the Datacenter.
  2. Add the ESXi host under the necessary VDS Networks (optional).
  3. Add the ESXi host under CVDS Network and configure Physical Adapter for the CVDS connection.
  4. Move the ESXi host to the Cluster where Hostbased SI is deployed:

    a. Here, TNP Configuration starts for the ESX automatically and gets stuck during the step "vLCM Remediation Initiated" due to EAM Health Check and then fails after ~15 minutes.

    b. After the above failure, vLCM Compliance check is run automatically and it shows that the ESXi is compliant.
     
  5. Exit Maintenance Mode for the ESXi host.
  6. Re-Apply TNP from NSX UI (Click on the Error Displayed for TN and Resolving it would Re-Apply the TNP to the ESXi). The TNP Re-Apply would succeed shortly. Also, SVM Deployment for the ESX will be done and Service Deployment Status will be Up.