Downloading Esx metadata, vibs and vendor add-ons task failing in VCF operations

Products

• VCF Operations

Issue/Introduction

When operating VMware Cloud Foundation (VCF) and attempting to synchronize the UMDS or download patches, you may encounter the following issues:

• Checksum Mismatches: VIBs downloaded from the fleet depot have a different SHA256 checksum compared to the identical VIBs downloaded directly from the offline depot, even though the file sizes remain exactly the same.

• UMDS Sync Task Failure: The task Downloading Esx metadata, vibs and vendor add-ons (Type: UMDS_SYNC) fails with the following error:

  Message: Failed to execute UMDS command: /opt/vmware/vmware-umds/bin/vmware-umds -D -m --info-level error --task-id...

• HTTP 404 Errors in Logs: While reviewing the log below it may indicate an HTTP Error Code:404 which indicates authentication issue.

  In SDDC-Manager  /var/log/vmware/vcf/lcm/lcm-debug.log

  ERROR vmware-downloadService 1134312 [Originator@4413 sub="HostUpdateDepotManager"] [patchDepotManager 2373] Error occured while downloading VVS bundle from URL: https://<DepotFQDN>/depot-service/content-gateway/PROD/COMP/ESX_HOST/patch-store/vvs/… Download error: HTTP Error Code: 404

Error log with failed vib download


  INFO  [vcf_lcm,6a560ad3cc4f446a87612e8f72fae29b,398f] [c.v.e.s.l.s.u.i.UmdsDownloadServiceImpl,pool-15-thread-2] ERROR vmware-downloadService 345125 [Originator@4413 sub="HostUpdateDepotManager"] [vibDownloaderImpl 236] Computed checksum: [ENCRYPTED DATA] of file: /nfs/vmware/vcf/nfs-mount/umds/patch-store/hostupdate/vmw/vib20/icen/INT_bootbank_icen_2.2.2.0-1OEM.800.1.0.20613240.vib.part differs from the expected checksum: [ENCRYPTED DATA]

Environment

VCF 9.0

Cause

This issue occurs due to a corrupted or stale cache entry within the depot-service proxy cache of the vcf-fleet-depot. When the cache holds an invalid version of the VIB or metadata, it serves a file with a corrupted payload (resulting in the checksum mismatch) or fails to serve the required VVS bundle paths entirely (resulting in the 404 error during UMDS sync).

Resolution

Contact Broadcom support

Additional Information

You can find additional causes for similar issues in the KB articles below:

Downloading Esx metadata, vibs and vendor add-ons UMDS_SYNC task fails Message: Failed to execute UMDS command: /opt/vmware/vmware-umds/bin/vmware-umds -D --info-level error --task-id

Downloading Esx metadata, vibs and vendor add-ons - Message: Failed to execute UMDS command: /opt/vmware/vmware-umds/bin/vmware-umds