NSX installation on host fails with error: "Failed to install software on host. Solution apply failed on host: 'hostname' Failed to apply Component nsx-lcp-bundle: an error occurred while enabling service nsx-datapath."

Products

• VMware NSX

Issue/Introduction

Following symptoms can be observed when adding new ESXi hosts to an existing vSphere Lifecycle Manager (vLCM) enabled cluster:

• After moving the new hosts to the cluster, the cluster is remediated with an image.

• The vSphere Client shows the cluster as successfully remediated and compliant with the image.
  
  

• However, in the NSX Manager UI, the newly added host reports an "Unknown" node status and an "Install Failed" state with the following error:

  Failed to install software on host. Solution apply failed on host: '<hostname>' Failed to apply Component nsx-lcp-bundle(4.#.#.1.0-8.0.24####28): an error occurred while enabling service nsx-datapath.Solution apply failed on host: '<hostname>'
  
  
  
  

• Upon inspection, the NSX VIBs are present and installed on the host from the time of cluster remediation.

• Despite the VIBs being present, the host is missing the necessary VMkernel adapters for the NSX overlay (e.g., vmk10, vmk11, vmk50).

• At the cluster level in the NSX UI, the Node Status shows "1 host with error" and the state shows "Preparation failed" with the following error code:

  Error Code 26189: vLCM remediation was skipped or failed for some hosts. List of failed host(s) [[UUID]]. Please check individual transport node status for more details.


  
  
  
  

Environment

VMware NSX

Cause

 vLCM remediation was skipped or failed for some hosts.

While vLCM successfully applies the desired image and the host is marked as compliant from vSphere Client, the subsequent steps for vLCM remediation from NSX was skipped or failed. 

Resolution

To resolve this issue :

1. Log in to the NSX Manager UI.

2. Navigate to System > Fabric > Nodes > Host Transport Nodes.

3. Locate the affected cluster and click on the "Preparation failed" error link under the Node Status column.

4. A prompt will appear stating:

   Confirm Resolve 26189: vLCM remediation was skipped or failed for some hosts. List of failed host(s) [[Host UUID]]. Please check individual transport node status for more details. You are about to reapply the Transport Node profile <Transport node profile name> to cluster <Host Cluster name>. Are you sure, you want to proceed?
   
   
   

5. Click the RESOLVE button.

6. This action will reapply the Transport Node Profile on the cluster and reinitiate the NSX configuration and installation process on the affected host.

7. Once the process completes successfully, verify that the Node Status returns to "Success" and confirm that the required NSX overlay VMkernel adapters (vmk10, vmk11, vmk50) are now present on the host.

Additional Information

If the hosts are reporting as "Incompatible" with the overall desired image rather than simply failing installation, please refer to the following Broadcom KB articles:

• NSX host preparation using vLCM fails when applying a Transport Node Profile (TNP) to a ESXi cluster

• NSX Host Preparation fails in vLCM enable cluster - Failed to apply Component nsx-lcp-bundle(4.2.3.0.0-7.0...): an error occurred while enabling service nsx-datapath