vLCM image compliance check fails with "An unknown error occurred while performing the operation."
search cancel

vLCM image compliance check fails with "An unknown error occurred while performing the operation."

book

Article ID: 372338

calendar_today

Updated On:

Products

VMware vSphere ESXi 8.0 VMware vCenter Server 8.0

Issue/Introduction

  • vLCM image compliance check fails with "An unknown error occurred while performing the operation."
  • Log file /var/run/log/lifecycle.log on ESXi will show similar to below snippets:

YYYY-MM-DDThh:mm:ssZ Db(15) lifecycle[155186763]: ImageProfile:1128 Adding Component VMware-VM-Tools_12.2.5.218556##-2208### to ImageProfile (Updated) VMware Lifecycle Manager Generated Image
YYYY-MM-DDThh:mm:ssZ Db(15) lifecycle[155186763]: ImageProfile:1136 Removing reserved Component VMware-VM-Tools_12.2.5.218556##-220823## in ImageProfile (Updated) VMware Lifecycle Manager Generated Image
YYYY-MM-DDThh:mm:ssZ Er(11) lifecycle[155186763]: imagemanagerctl:98 [ValueError]
YYYY-MM-DDThh:mm:ssZ Er(11)[+] lifecycle[155186763]: Cannot merge unequal components.
YYYY-MM-DDThh:mm:ssZ Er(11) lifecycle[155186763]: imagemanagerctl:103 Traceback (most recent call last):
YYYY-MM-DDThh:mm:ssZ Er(11) lifecycle[155186763]: imagemanagerctl:103 File "/usr/lib/vmware/lifecycle/bin/imagemanagerctl.py", line 373, in software
YYYY-MM-DDThh:mm:ssZ Er(11) lifecycle[155186763]: imagemanagerctl:103 t.ScanImage(swSpec, opts.depots, opts.taskId)
YYYY-MM-DDThh:mm:ssZ Er(11) lifecycle[155186763]: imagemanagerctl:103 File "/lib64/python3.8/site-packages/vmware/esximage/Transaction.py", line 1883, in ScanImage
YYYY-MM-DDThh:mm:ssZ Er(11) lifecycle[155186763]: imagemanagerctl:103 *_getPatcherFromImageSpec(imageSpec, depotUrls))
YYYY-MM-DDThh:mm:ssZ Er(11) lifecycle[155186763]: imagemanagerctl:103 File "/lib64/python3.8/site-packages/vmware/esximage/Transaction.py", line 2789, in _getPatcherFromImageSpec
YYYY-MM-DDThh:mm:ssZ Er(11) lifecycle[155186763]: imagemanagerctl:103 specMgr = _getSoftwareSpecMgr(imageSpec, depotUrls)
YYYY-MM-DDThh:mm:ssZ Er(11) lifecycle[155186763]: imagemanagerctl:103 File "/lib64/python3.8/site-packages/vmware/esximage/Transaction.py", line 2908, in _getSoftwareSpecMgr
YYYY-MM-DDThh:mm:ssZ Er(11) lifecycle[155186763]: imagemanagerctl:103 depotMgr = DepotMgr.DepotMgr(depotSpec, connect=True)
YYYY-MM-DDThh:mm:ssZ Er(11) lifecycle[155186763]: imagemanagerctl:103 File "/lib64/python3.8/site-packages/vmware/esximage/ImageManager/DepotMgr.py", line 103, in __init__
YYYY-MM-DDThh:mm:ssZ Er(11) lifecycle[155186763]: imagemanagerctl:103 self._connect(ignoreError=ignoreError, validate=validate)
YYYY-MM-DDThh:mm:ssZ Er(11) lifecycle[155186763]: imagemanagerctl:103 File "/lib64/python3.8/site-packages/vmware/esximage/ImageManager/DepotMgr.py", line 178, in _connect
YYYY-MM-DDThh:mm:ssZ Er(11) lifecycle[155186763]: imagemanagerctl:103 self._loadLocalMetadata()
YYYY-MM-DDThh:mm:ssZ Er(11) lifecycle[155186763]: imagemanagerctl:103 File "/lib64/python3.8/site-packages/vmware/esximage/ImageManager/DepotMgr.py", line 196, in _loadLocalMetadata
YYYY-MM-DDThh:mm:ssZ Er(11) lifecycle[155186763]: imagemanagerctl:103 self._loadProfileMetadata(p)
YYYY-MM-DDThh:mm:ssZ Er(11) lifecycle[155186763]: imagemanagerctl:103 File "/lib64/python3.8/site-packages/vmware/esximage/ImageManager/DepotMgr.py", line 203, in _loadProfileMetadata
YYYY-MM-DDThh:mm:ssZ Er(11) lifecycle[155186763]: imagemanagerctl:103 self.components.AddComponent(comp)
YYYY-MM-DDThh:mm:ssZ Er(11) lifecycle[155186763]: imagemanagerctl:103 File "/lib64/python3.8/site-packages/vmware/esximage/Bulletin.py", line 1487, in AddComponent
YYYY-MM-DDThh:mm:ssZ Er(11) lifecycle[155186763]: imagemanagerctl:103 self[name][version] += comp
YYYY-MM-DDThh:mm:ssZ Er(11) lifecycle[155186763]: imagemanagerctl:103 File "/lib64/python3.8/site-packages/vmware/esximage/Bulletin.py", line 1063, in __add__
YYYY-MM-DDThh:mm:ssZ Er(11) lifecycle[155186763]: imagemanagerctl:103 raise ValueError("Cannot merge unequal components.")
YYYY-MM-DDThh:mm:ssZ Er(11) lifecycle[155186763]: imagemanagerctl:103 ValueError: Cannot merge unequal components.

  • Update Manager log on vCenter Server /var/log/vmware/vmware-updatemgr/vum-server/vmware-vum-server.log will log similar to below snippets:

YYYY-MM-DDThh:mm:ss.746+08:00 info vmware-vum-server[138038] [Originator@6876 sub=DraftsManager] [DraftsManager 596] Successfully retrieved desired Spec for the entity: domain-c8
YYYY-MM-DDThh:mm:ss.746+08:00 warning vmware-vum-server[13018] [Originator@6876 sub=InventoryTree] [InventoryTree 403] [AcquireWriteLock] Timed out after 10000 microseconds, to lock node domain-c8.
YYYY-MM-DDThh:mm:ss.746+08:00 warning vmware-vum-server[13018] [Originator@6876 sub=InventoryTree] [InventoryTree 2280] Failed to write lock domain-c8; Timed out while acquiring the lock for domain-c8
YYYY-MM-DDThh:mm:ss.746+08:00 info vmware-vum-server[138038] [Originator@6876 sub=ScanUtil] [ScanUtil 1159] Successfully retrieved software spec for the entity : Prod (domain-c8)
--> {
--> "add_on": {
--> "name": "Cisco-UCS-Addon-ESXi",
--> "version": "4.3.1-a"
--> },
--> "base_image": {
--> "version": "8.0.1-0.25.22088125"
--> },
--> "components": null,
--> "hardware_support": null,
--> "solutions": {
--> "com.vmware.nsxt": {
--> "components": [
--> {
--> "component": "nsx-lcp-bundle"
--> }
--> ],
--> "version": "4.1.0.2.0-21761693"
--> },

 

Environment

  • VMware vSphere ESXi 8.x
  • VMware vCenter Server 8.x

Cause

Discrepancies in nsx-lcp component uploaded to vCenter server as part of VUM DB reset on NSX-T enabled cluster:  Resetting VMware Update Manager Database in vCenter Server Appliance 6.5/6.7/7.0/8.0

From ESXi component list, we see the nsx-lcp id as:
esxcli software  component get
vmw-nsx-lcp_4.1.0.0.0.21332675-esx80-snic-system

From the vCenter /storage/updatemgr/patch-store/hostupdate/vmw/metadata-151.zip bundle, we see id as:
vmw-nsx-lcp_4.1.0.0.0.21332675-esx80

  • Note: You will need to extract metadata-*.zip file and review 'vmware.xml' to identify nsx-lcp bulletin id. 
  • Example:

<metadataResponse>
  <version>3.0</version>
  <timestamp>YYYY-MM-DDThh:mm:ss.234721</timestamp>
  <bulletin>
    <id>vmw-nsx-lcp_4.1.0.2.0.21761693-esx80</id>
    <vendor>VMware</vendor>
    <summary>NSX LCP Bundle</summary>

Resolution

  1. Backup nsx-lcp corresponding metadata-*.zip file and remove the file from /storage/updatemgr/patch-store/hostupdate/vmw/
  2. Create an empty vLCM cluster in VC. 
  3. In NSX apply TNP to the empty cluster created in previous step
  4. As part of "Apply TNP" workflow NSX uploads relevant depots into VC.
Powered by Wolken Software