Async patches - VMware Software Update 1.1.1.1 missing in SDDC Bundle management.

Products

VMware SDDC Manager

Issue/Introduction

SDDC Manager has Async patch bundles missing for the components in the Bundle Management page.
Navigating to plan patches dose not list the latest Async patches : Applying individual product updates to VMware Cloud Foundation environments using Async Patch Tool (AP Tool)
Error snippets on /var/log/vmware/lcm/lcm-debug.log:

^{yyyy-mm-ddThh:mm:ss ERROR [vcf_lcm] [c.v.e.s.l.c.s.BundleManifestDownloadScheduler,vac-scheduler-1] Getting file size for [/COMP/SDDC_MANAGER_VCF/lcm/productVersionCatalog)/v1/productVersionCatalog.json%29/v1/productVersionCatalog.json] from URL [https://dl.broadcom.com:443/download_token/PROD/COMP/SDDC_MANAGER_VCF/lcm/productVersionCatalog%29/v1/productVersionCatalog.json]}
^{yyyy-mm-ddThh:mm:ss ERROR [vcf_lcm] [c.v.e.s.l.c.s.BundleManifestDownloadScheduler,vac-scheduler-1] Executing HEAD /download_token/PROD/COMP/SDDC_MANAGER_VCF/lcm/productVersionCatalog%29/v1/productVersionCatalog.json}
^{yyyy-mm-ddThh:mm:ss ERROR [vcf_lcm] [c.v.e.s.l.c.s.BundleManifestDownloadScheduler,vac-scheduler-1] Got response: 403 Forbidden HTTP/1.1}
^{yyyy-mm-ddThh:mm:ss ERROR [vcf_lcm] [c.v.e.s.l.c.s.BundleManifestDownloadScheduler,vac-scheduler-1] Error getting file size, got response: 403 Forbidden HTTP/1.1}
^{yyyy-mm-ddThh:mm:ss ERROR [vcf_lcm] [c.v.e.s.l.b.d.d.DepotBundleDownloadServiceImpl,vac-scheduler-1] Got Http error[403] while downloading LCM Product Version Catalog [/COMP/SDDC_MANAGER_VCF/lcm/productVersionCatalog)/v1/productVersionCatalog.json]}
The URL in the log indicates invalid characters - https://dl.broadcom.com:443/download_token/PROD/COMP/SDDC_MANAGER_VCF/lcm/productVersionCatalog%29/v1/productVersionCatalog.json

Environment

VMware Cloud Foundation 5.x

Cause

Invalid character in ProductVersionCatalog file path. File /opt/vmware/vcf/lcm/lcm-app/conf/application-prod.properties, at line lcm.depot.adapter.remote.lcmProductVersionCatalogDir=/evo/vmw/lcm/productVersionCatalog
Validate using the below command and compare the lcm.depot.adapter.remote.lcmProductVersionCatalogDir to match with KB "Depot connection has issues. Depot Invalid User Credential", SDDC fails to download the updates from online repositories

^{root@sdc001 [ / ]# cat /opt/vmware/vcf/lcm/lcm-app/conf/application-prod.properties | grep "lcm.depot.adapter.remote.lcmProductVersionCatalogDir"}^{lcm.depot.adapter.remote.lcmProductVersionCatalogDir=}^{/COMP/SDDC_MANAGER_VCF/lcm/productVersionCatalog}⁾

From the above output, ')' is invalid. The correct path is

lcm.depot.adapter.remote.lcmProductVersionCatalogDir=/COMP/SDDC_MANAGER_VCF/lcm/productVersionCatalog

Resolution

1. Take a snapshot of the SDDC manager.

2. Take a backup of the application-prod.properties file:

cp /opt/vmware/vcf/lcm/lcm-app/conf/application-prod.properties /opt/vmware/vcf/lcm/lcm-app/conf/application-prod.properties.bak

3. Edit the file using

vi application-prod.properties

4. Update the path in the below line to remove invalid characters present in /COMP/SDDC_MANAGER_VCF/lcm/productVersionCatalog. Save the file with the command ESC:wq!

lcm.depot.adapter.remote.lcmProductVersionCatalogDir=/COMP/SDDC_MANAGER_VCF/lcm/productVersionCatalog

5. Restart the lcm service in SDDC manager

systemctl restart lcm

6. Reload the bundle management page. The VMware Software Update 1.1.1.1 bundles, should now be available to download.

Additional Information

The issue can occur the there is also a space after productVersionCatalog in the path /COMP/SDDC_MANAGER_VCF/lcm/productVersionCatalog. KB - Plan Patching for the vCenter server shows "No patches available" in SDDC 5.2.x