vLCM cluster creation seeded from a reference host fails with failure to extract image
search cancel

vLCM cluster creation seeded from a reference host fails with failure to extract image

book

Article ID: 339531

calendar_today

Updated On:

Products

VMware vSphere ESXi

Issue/Introduction

Possible situation occurrence is in version 7.0 U2 or later
Note: Creating vLCM clusters using a host as a reference was introduced in 7.0U2.

Scenario: 
A host was deployed with the 7.0 GA release with async vibs from OEMs. Async vibs are the vibs from OEMs that are of a higher version than the default VMware vibs.
At some point, this host has been upgraded using vLCM to 7.0U2 Base Image along with the same set of async vibs. Since async vibs are already installed on the host, they are just carried forward after the upgrade. 

When a vLCM cluster is created with the desired state to be extracted from this reference host, the extraction of the image from the host fails with a similar log snippet in the lifecycle.log as below

/var/run/log/lifecycle.log: 
[YYYY-MM-DDTHH:MM:SS] lifecycle: 2103604: HostSeeding:910 DEBUG Creating directory /var/vmware/lifecycle/hostSeed
[YYYY-MM-DDTHH:MM:SS] lifecycle: 2103604: HostSeeding:111 DEBUG Calculated sha256 checksum of payload mtip32xx 'c5a74b90cafa113f7b05ba6508d8839383bb3a3c090c35806f9339052e39d208', expected 'c5a74b90cafa113f7b05ba6508d8839383bb3a3c090c35806f9339052e39d208'
[YYYY-MM-DDTHH:MM:SS] lifecycle: 2103604: HostSeeding:111 DEBUG Calculated sha256 checksum of payload ixgben '534e066344b47717c07703601ea2884fc5ba9daefce3c2db751eaf6f5523f35c', expected 'f12b567701e2cc23ac45d3016a4bfb4b438feecb729c9e87cfacde38b67a8c3c'
[YYYY-MM-DDTHH:MM:SS] lifecycle: 2103604: HostSeeding:956 ERROR Extract depot failed: ('INT_bootbank_ixgben_1.8.9.0-1OEM.700.1.0.15525992', 'Cannot find or stage payload ixgben type vgz of VIB INT_bootbank_ixgben_1.8.9.0-1OEM.700.1.0.15525992: Calculated sha256 checksum of payload ixgben does not match VIB metadata')
[YYYY-MM-DDTHH:MM:SS] lifecycle: 2103604: imagemanagerctl:373 ERROR Extract depot failed.
[YYYY-MM-DDTHH:MM:SS] lifecycle: 2103604: imagemanagerctl:152 ERROR [VibRecreateError] ('INT_bootbank_ixgben_1.8.9.0-1OEM.700.1.0.15525992', 'Cannot find or stage payload ixgben type vgz of VIB INT_bootbank_ixgben_1.8.9.0-1OEM.700.1.0.15525992: Calculated sha256 checksum of payload ixgben does not match VIB metadata')
[YYYY-MM-DDTHH:MM:SS] lifecycle: 2103604: imagemanagerctl:157 ERROR Traceback (most recent call last):
[YYYY-MM-DDTHH:MM:SS] lifecycle: 2103604: imagemanagerctl:157 ERROR File "/lib64/python3.8/site-packages/vmware/esximage/Depot.py", line 922, in GenerateVib
[YYYY-MM-DDTHH:MM:SS] lifecycle: 2103604: imagemanagerctl:157 ERROR stagePath = getBootBankPayloadPath(vibobj, name, hostImage,
[YYYY-MM-DDTHH:MM:SS] lifecycle: 2103604: imagemanagerctl:157 ERROR File "/lib64/python3.8/site-packages/vmware/esximage/ImageManager/HostSeeding.py", line 211, in getBootBankPayloadPath
[YYYY-MM-DDTHH:MM:SS] lifecycle: 2103604: imagemanagerctl:157 ERROR _checkPayloadChecksum(fObj, pObj)
[YYYY-MM-DDTHH:MM:SS] lifecycle: 2103604: imagemanagerctl:157 ERROR File "/lib64/python3.8/site-packages/vmware/esximage/ImageManager/HostSeeding.py", line 115, in _checkPayloadChecksum
[YYYY-MM-DDTHH:MM:SS] lifecycle: 2103604: imagemanagerctl:157 ERROR raise RuntimeError('Calculated %s checksum of payload %s does not '
[YYYY-MM-DDTHH:MM:SS] lifecycle: 2103604: imagemanagerctl:157 ERROR RuntimeError: Calculated sha256 checksum of payload ixgben does not match VIB metadata
[YYYY-MM-DDTHH:MM:SS] lifecycle: 2103604: imagemanagerctl:157 ERROR
[YYYY-MM-DDTHH:MM:SS] lifecycle: 2103604: imagemanagerctl:157 ERROR During handling of the above exception, another exception occurred:
[YYYY-MM-DDTHH:MM:SS] lifecycle: 2103604: imagemanagerctl:157 ERROR
[YYYY-MM-DDTHH:MM:SS] lifecycle: 2103604: imagemanagerctl:157 ERROR Traceback (most recent call last):
[YYYY-MM-DDTHH:MM:SS] lifecycle: 2103604: imagemanagerctl:157 ERROR File "/usr/lib/vmware/lifecycle/bin/imagemanagerctl.py", line 371, in depots
[YYYY-MM-DDTHH:MM:SS] lifecycle: 2103604: imagemanagerctl:157 ERROR HostSeeding.InstalledImageInfo().extractDepot(task)
[YYYY-MM-DDTHH:MM:SS] lifecycle: 2103604: imagemanagerctl:157 ERROR File "/lib64/python3.8/site-packages/vmware/esximage/ImageManager/HostSeeding.py", line 942, in extractDepot
[YYYY-MM-DDTHH:MM:SS] lifecycle: 2103604: imagemanagerctl:157 ERROR Depot.DepotFromImageProfile(newProfile, depotDir,
[YYYY-MM-DDTHH:MM:SS] lifecycle: 2103604: imagemanagerctl:157 ERROR File "/lib64/python3.8/site-packages/vmware/esximage/Depot.py", line 1026, in DepotFromImageProfile
[YYYY-MM-DDTHH:MM:SS] lifecycle: 2103604: imagemanagerctl:157 ERROR vibdownloadfn(localfn, allRelatedVibs[vibid],
[YYYY-MM-DDTHH:MM:SS] lifecycle: 2103604: imagemanagerctl:157 ERROR File "/lib64/python3.8/site-packages/vmware/esximage/Depot.py", line 932, in GenerateVib
[YYYY-MM-DDTHH:MM:SS] lifecycle: 2103604: imagemanagerctl:157 ERROR raise Errors.VibRecreateError(vibobj.id, msg)
[YYYY-MM-DDTHH:MM:SS] lifecycle: 2103604: imagemanagerctl:157 ERROR vmware.esximage.Errors.VibRecreateError: ('INT_bootbank_ixgben_1.8.9.0-1OEM.700.1.0.15525992', 'Cannot find or stage payload ixgben type vgz of VIB INT_bootbank_ixgben_1.8.9.0-1OEM.700.1.0.15525992: Calculated sha256 checksum of payload ixgben does not match VIB metadata')

 

Environment

VMware vSphere ESXi 7.0.x
VMware vSphere ESXi 7.0.2

Cause

Seeding from a host requires recreating the complete ESXi image from the host. This step involves maintaining and reusing some metadata about the vibs. Since pre-7.0U2 images did not have this feature, the metadata of the individual vibs is lost, and hence the image cannot be recreated.

Resolution

Perform the below workarounds to use this feature

  1. Post upgrade from a pre 7.0U2 release to a >= 7.0U2 release, update the async vibs to a higher version, if one is available. 
  2. If vLCM has been used to upgrade the host from a pre-7.0U2 release to 7.0U2 or above, ensure that the async vibs are removed before the upgrade and after placing the host in maintenance mode. Since the upgrade desired state contain the async vibs, they will get reinstalled with all the necessary metadata preserved.

  3. Use cli commands to upgrade the host from pre-7.0U2 release to 7.0U2 and above instead of vLCM.
    Patching ESXi host using Command Line

 

Powered by Wolken Software