NSX upgrade failed : Host Upgrade Failure on vLCM Enabled Cluster During NSX Upgrade
Article ID: 434624
Updated On:
Products
Issue/Introduction
- An upgrade failure occurrs midway through the host upgrade from NSX 3.x to 4.X with the below error :
Failed to install software on host. Solution apply failed because the vSphere Lifecycle image contains either a new ESXi version or a new addons version or new components. Please proceed to the vSphere Client Lifecycle Manager to update ESXi or addons or components along with the solution 'com.vmware.nsxt' Solution apply failed on host: 'esxi1.example.com'. The vSphere Lifecycle Manager image contains a new 'ESXi' version '<vSphere ESXi version>'. Please proceed to the vSphere Client Lifecycle Manager to update ESXi and the solution 'com.vmware.nsxt'Solution apply failed on host: 'esxi1.example.com'
- The Host cluster & the hosts status shows up and successful in NSX UI.
- The NSX Upgrade Prechecks does not detect this drift as previous NSX installations for the hosts were reported as successful.
- This issue is a critical blocker to completing the NSX upgrade.
- Host can be seen with below error: " Host is out of compliance with the image " in vCenter UI.
- The Image at the cluster level is different than the image of the host.
Environment
VMware NSX
Cause
Host non-compliance within the vLCM enabled cluster is blocking the installation of the NSX components.
Discrepancies between the current host software and the desired Image set in vLCM prevent remediation.
Resolution
Resolution:
Remediate the non-compliant hosts using vLCM to ensure they meet the cluster's image requirements.
- Resume the NSX upgrade via the Upgrade Coordinator on UI once all hosts report a compliant status.
Proactive Validation Steps to Prevent Upgrade Failures
This issue is not reported in the NSX Upgrade precheck because previous NSX installations for the hosts were successful. The issue only surfaces when attempting to install the NSX VIBs during the upgrade. Please follow the method below to proactively detect this issue during the precheck phase:
Steps to Check Host Image Compliance with VLCM in vCenter UI :
Log in to the vSphere Client.
Navigate to Menu > Hosts and Clusters.
In the inventory tree on the left, select the Cluster you want to inspect. (Note: vLCM image management is configured at the cluster level).
In the main pane, click on the Updates tab.
On the left side of the Updates pane, under the vSphere Lifecycle Manager section, click on Image.
At the top right of the Image pane, click the Check Compliance button.
This forces vLCM to actively scan all hosts in the cluster and compare their current software, drivers, and firmware against the Desired Image you have set.
Wait for the task to complete (you can monitor it in the Recent Tasks pane at the bottom).
Scroll down to the Image Compliance card. Here you will see a summary of your cluster's compliance status.
Click on See Details or click directly on the status links (e.g., "1 host Out of Compliance").
Select the specific non-compliant host from the list. The bottom pane will display a detailed Report.
- If any host Out of Compliance is reported please remidiate the host prior to upgrade to proactively prevent this upgrade failure.
Additional Information
Feedback
