ESXi Host seeding is failing on "extract on custom content autobootstrapped host"

Products

• VMware vSphere ESXi

Issue/Introduction

ESXi Host seeding fails under the below conditions:

• Create vLCM with Base Image + vendor add-on.
• Create Auto deploy rule having vLCM cluster as target.
• Auto-bootstrap the host to vLCM cluster
• Now seed from the auto-bootstrapped host (Here seeding will fail at extract)

Log /var/run/log/lifecycle.log:

[YYYY-MM-DDTHH:MM:SS] lifecycle: 1060656: HostSeeding:956 ERROR Extract depot failed: ('MEL_bootbank_nmlx4-en_3.19.70.1-1OEM.670.0.0.8169922', 'Cannot find or stage payload nmlx4-en type vgz of VIB MEL_bootbank_nmlx4-en_3.19.70.1-1OEM.670.0.0.81
[YYYY-MM-DDTHH:MM:SS] lifecycle: 1060656: imagemanagerctl:373 ERROR Extract depot failed.
[YYYY-MM-DDTHH:MM:SS] lifecycle: 1060656: imagemanagerctl:152 ERROR [VibRecreateError] ('MEL_bootbank_nmlx4-en_3.19.70.1-1OEM.670.0.0.8169922', 'Cannot find or stage payload nmlx4-en type vgz of VIB MEL_bootbank_nmlx4-en_3.19.70.1-1OEM.670.0.0.8
[YYYY-MM-DDTHH:MM:SS] lifecycle: 1060656: imagemanagerctl:157 ERROR Traceback (most recent call last):
[YYYY-MM-DDTHH:MM:SS] lifecycle: 1060656: imagemanagerctl:157 ERROR File "/lib64/python3.8/site-packages/vmware/esximage/Depot.py", line 928, in GenerateVib
[YYYY-MM-DDTHH:MM:SS] lifecycle: 1060656: imagemanagerctl:157 ERROR stagePath = getBootBankPayloadPath(vibobj, name, hostImage,
[YYYY-MM-DDTHH:MM:SS] lifecycle: 1060656: imagemanagerctl:157 ERROR File "/lib64/python3.8/site-packages/vmware/esximage/ImageManager/HostSeeding.py", line 211, in getBootBankPayloadPath
[YYYY-MM-DDTHH:MM:SS] lifecycle: 1060656: imagemanagerctl:157 ERROR _checkPayloadChecksum(fObj, pObj)
[YYYY-MM-DDTHH:MM:SS] lifecycle: 1060656: imagemanagerctl:157 ERROR File "/lib64/python3.8/site-packages/vmware/esximage/ImageManager/HostSeeding.py", line 115, in _checkPayloadChecksum
[YYYY-MM-DDTHH:MM:SS] lifecycle: 1060656: imagemanagerctl:157 ERROR raise RuntimeError('Calculated %s checksum of payload %s does not '
[YYYY-MM-DDTHH:MM:SS] lifecycle: 1060656: imagemanagerctl:157 ERROR RuntimeError: Calculated sha256 checksum of payload nmlx4-en does not match VIB metadata
[YYYY-MM-DDTHH:MM:SS] lifecycle: 1060656: imagemanagerctl:157 ERROR
[YYYY-MM-DDTHH:MM:SS] lifecycle: 1060656: imagemanagerctl:157 ERROR During handling of the above exception, another exception occurred:
[YYYY-MM-DDTHH:MM:SS] lifecycle: 1060656: imagemanagerctl:157 ERROR
[YYYY-MM-DDTHH:MM:SS] lifecycle: 1060656: imagemanagerctl:157 ERROR Traceback (most recent call last):
[YYYY-MM-DDTHH:MM:SS] lifecycle: 1060656: imagemanagerctl:157 ERROR File "/usr/lib/vmware/lifecycle/bin/imagemanagerctl.py", line 371, in depots
[YYYY-MM-DDTHH:MM:SS] lifecycle: 1060656: imagemanagerctl:157 ERROR HostSeeding.InstalledImageInfo().extractDepot(task)
[YYYY-MM-DDTHH:MM:SS] lifecycle: 1060656: imagemanagerctl:157 ERROR File "/lib64/python3.8/site-packages/vmware/esximage/ImageManager/HostSeeding.py", line 942, in extractDepot
[YYYY-MM-DDTHH:MM:SS] lifecycle: 1060656: imagemanagerctl:157 ERROR Depot.DepotFromImageProfile(newProfile, depotDir,
[YYYY-MM-DDTHH:MM:SS] lifecycle: 1060656: imagemanagerctl:157 ERROR File "/lib64/python3.8/site-packages/vmware/esximage/Depot.py", line 1032, in DepotFromImageProfile
[YYYY-MM-DDTHH:MM:SS] lifecycle: 1060656: imagemanagerctl:157 ERROR vibdownloadfn(localfn, allRelatedVibs[vibid],
[YYYY-MM-DDTHH:MM:SS] lifecycle: 1060656: imagemanagerctl:157 ERROR File "/lib64/python3.8/site-packages/vmware/esximage/Depot.py", line 938, in GenerateVib
[YYYY-MM-DDTHH:MM:SS] lifecycle: 1060656: imagemanagerctl:157 ERROR raise Errors.VibRecreateError(vibobj.id, msg)
[YYYY-MM-DDTHH:MM:SS] lifecycle: 1060656: imagemanagerctl:157 ERROR vmware.esximage.Errors.VibRecreateError: ('MEL_bootbank_nmlx4-en_3.19.70.1-1OEM.670.0.0.8169922', 'Cannot find or stage payload nmlx4-en type vgz of VIB MEL_bootbank_nmlx4-en_3.

 

Environment

VMware vSphere ESXi 7.0.3

Resolution

To resolve this issue, you may need to seed from ESXi Host which is not auto-bootstrapped.


Workaround:
1. Add 7.0 U3C host to vLCM cluster where cluster image is 7.0 U3C + vendor add-on.
2. Remediate the 7.0 U3C ESXi host to install vendor add-on.
3. Seed from the ESXi host