SDDC Manager Depot connection error - Failed to connect to VMware depot with the provided user credentials. Cause: {0}.

Products

• VMware SDDC Manager
• VMware Cloud Foundation 5.x
• VMware Cloud Foundation

Issue/Introduction

• After executing the steps in either of below KBs, VMware depot is not getting connected and is failing with below error:
  
  

  Failed to connect to VMware depot with the provided user credentials. Cause: {0}.

   

  • Authenticated Download Configuration Update Script 
  • "Depot connection has issues. Depot Invalid User Credential", SDDC fails to download the updates from online repositories
    
    
• Errors in /var/log/vmware/vcf/lcm/lcm-debug.log in SDDC Manager:
  
  

  INFO  [vcf_lcm,92############78,0da5] [c.v.v.l.r.a.c.v.s.DepotSettingsController,http-nio-127.0.0.1-7400-exec-1] Update Depot Settings: { "vmwareAccount": { "username": "<depot_user>", "password": "*****" } }
  INFO  [vcf_lcm,92############78,0da5] [c.v.e.s.l.s.i.DepotSettingsServiceImpl,http-nio-127.0.0.1-7400-exec-1] Updating VCF_DEPOT account
  DEBUG [vcf_lcm,92############78,0da5] [c.v.e.s.l.b.d.d.utils.CookieUtils,http-nio-127.0.0.1-7400-exec-1] VCF_DEPOT Depot Http Cookies: []
  DEBUG [vcf_lcm,92############78,0da5] [c.v.e.s.l.b.d.depot.DepotDownloader,http-nio-127.0.0.1-7400-exec-1] Getting file size for [/COMP/SDDC_MANAGER_VCF/index.v3] from URL[https://dl.broadcom.com:443/<TOKEN_GENERATED_FROM_SUPPORT_PORTAL>/PROD/COMP/SDDC_MANAGER_VCF/index.v3]
  DEBUG [vcf_lcm,92############78,0da5] [c.v.e.s.l.b.d.d.utils.CookieUtils,http-nio-127.0.0.1-7400-exec-1] VCF_DEPOT Depot Http Cookies: []
  DEBUG [vcf_lcm,92############78,0da5] [c.v.e.s.l.b.d.depot.DepotDownloader,http-nio-127.0.0.1-7400-exec-1] Executing HEAD /<TOKEN_GENERATED_FROM_SUPPORT_PORTAL>/PROD/COMP/SDDC_MANAGER_VCF/index.v3
  INFO  [vcf_lcm,92############78,0da5] [o.a.h.c.h.i.c.HttpRequestRetryExec,http-nio-127.0.0.1-7400-exec-1] Recoverable I/O exception (java.net.SocketException) caught when processing request to {s}->https://dl.broadcom.com:443
  ERROR [vcf_lcm,92############78,0da5] [c.v.e.s.l.b.d.depot.DepotDownloader,http-nio-127.0.0.1-7400-exec-1] Got exception while downloading manifest index [/COMP/SDDC_MANAGER_VCF/index.v3]: Network is unreachable
  ERROR [vcf_lcm,92############78,0da5] [c.v.v.l.r.a.c.v.s.DepotSettingsController,http-nio-127.0.0.1-7400-exec-1] Update Depot Settings
  com.vmware.evo.sddc.lcm.model.depot.exception.DepotConnectionFailureException: Internal error while validating credentials
          at com.vmware.evo.sddc.lcm.bundle.download.depot.DepotDownloader.validateUser(DepotDownloader.java:410)

   

• In some scenarios, configuring depot may be stuck at "Saving Depot settings" and get unconfigured later without any errors on the GUI however, the logs show above snippets.
• The new download URL "dl.broadcom.com" is not yet allowed in the firewall.

Environment

VMware SDDC Manager

Resolution

To resolve this issue allow https://dl.broadcom.com:443/<TOKEN_GENERATED_FROM_SUPPORT_PORTAL> in the firewall

Workaround:

Import Firewall's proxy server certificate in SDDC Manager trust store - Refer How to import Proxy server certificate to SDDC manager trust store.

You may also add the CA certificates of the dl.broadcom.com into the trusted roots store of the SDDC Manager via API explorer.

Additional Information

The same error message can be shown if the old public repositories are still used in the VCF environment.

In that case follow steps from KB article 390098 to update the depot settings with the new unique per customer token based URLs.