Downloading specific bundles from SDDC fails with error "DepotConnectionFailureException: Error downloading bundle [/COMP/SDDC_MANAGER_VCF/bundles/bundle-######.tar] from dl.broadcom.com:443"

Products

• VMware SDDC Manager
• VMware Cloud Foundation

Issue/Introduction

• Downloading the bundles of large sizes from SDDC fails with an error - 
  
  
  
  

• Under /var/log/vmware/vcf/lcm/lcm.log, below log snippets are found:
  
  YYYY-MM-DD ERROR [vcf_lcm,############################,####,bundleId=########-####-####-####-############] [c.v.e.s.l.b.d.d.DepotBundleDownloadServiceImpl,vac-scheduler-1] Got IOException while downloading bundle [/COMP/SDDC_MANAGER_VCF/bundles/bundle-######.tar]: Premature end of Content-Length delimited message body (expected: ###########; received: ###########)
YYYY-MM-DD ERROR [vcf_lcm,############################,####] [c.v.e.s.l.s.i.BundleDownloadExceptionHandlerImpl,vac-scheduler-1] Bundle download failed
com.vmware.evo.sddc.lcm.model.depot.exception.DepotConnectionFailureException: Error downloading bundle [/COMP/SDDC_MANAGER_VCF/bundles/bundle-######.tar] from dl.broadcom.com:443
        at com.vmware.evo.sddc.lcm.bundle.download.depot.DepotBundleDownloadServiceImpl.getBundle(DepotBundleDownloadServiceImpl.java:562)
        at com.vmware.evo.sddc.lcm.core.scheduler.BundleDownloadScheduler.bundleDownloadTask(BundleDownloadScheduler.java:367)

Environment

VMware Cloud Foundation 5.x

Cause

• The issue is encountered due to a forward proxy between Cloudflare and the local SDDC client.
• The proxy is interfering with the direct connection and causing download issues, particularly with large files.

 

Resolution

Resolution:

Bypass the proxy or use a different proxy that doesn't affect the download of files. 

Workaround:

As a workaround below steps can be performed to manually download bundles and upload to SDDC LCM

• SSH into the SDDC Manager VM as vcf.
• Run the below commands to create a folder and assign the required permissions:
  
  mkdir /nfs/vmware/vcf/nfs-mount/OfflineSideLoad/

chmod 777 /nfs/vmware/vcf/nfs-mount/OfflineSideLoad/
  
  
• Import the required files into the above mentioned folder, using the below commands:
  
  wget -e use_proxy=yes -e https_proxy=http://proxyserver:port https://dl.broadcom.com:443/token/PROD/COMP/SDDC_MANAGER_VCF/bundles/bundle-######.tar -P /nfs/vmware/vcf/nfs-mount/OfflineSideLoad

wget -e use_proxy=yes -e https_proxy=http://proxyserver:port https://dl.broadcom.com:443/token/PROD/COMP/SDDC_MANAGER_VCF/manifests/bundle-######.manifest -P /nfs/vmware/vcf/nfs-mount/OfflineSideLoad

wget -e use_proxy=yes -e https_proxy=http://proxyserver:port https://dl.broadcom.com:443/token/PROD/COMP/SDDC_MANAGER_VCF/manifests/bundle-######.manifest.sig -P /nfs/vmware/vcf/nfs-mount/OfflineSideLoad
  
  
• Use the below command to upload bundles to LCM:
  
  curl -X POST http://127.0.0.1/lcm/bundle/upload -d '{"bundle":"/nfs/vmware/vcf/nfs-mount/OfflineSideLoad/bundle-######.tar","manifest":"/nfs/vmware/vcf/nfs-mount/OfflineSideLoad/bundle-######.manifest","signature":"/nfs/vmware/vcf/nfs-mount/OfflineSideLoad/bundle-######.manifest.sig"}' -H 'Content-Type:application/json'