"Retrieving available bundles failed" after upgrade to SDDC Manager to 5.2.1

Products

• VMware SDDC Manager

Issue/Introduction

• Following a successful SDDC manager upgrade to 5.2.1 the Bundle Management tab reports that there are no bundles to display.
• In addition the tab shows 2 error messages:

Retrieving available bundles failed. Unable to retrieve aggregated domains upgrade status: Encountered fetching http://127.0.0.1/lcm/inventory/upgrades api - File with Compatibility Matrix Content for Compatibility controller VMWARE_COMPAT is not found.

and

Retrieving all applicable bundles failed. Encountered fetching http://127.0.0.1/lcm/inventory/upgrades api - File with Compatibility Matrix Content for Compatibility Controller VMWARE_COMPAT is not found.

As can be seen in the screenshot below:

• When reviewing the tasks, you see another error:

An error occurred when validating VMware Cloud Foundation compatibility: File with Compatibility Matrix Content for Compatibility controller VMWARE_COMPAT is not found.

• When reviewing the Lifecycle Manager log, /var/log/vmware/vcf/lcm/lcm.log, you find errors like the following one:

  ERROR [vcf_lcm,67cfa0d09eeed086b1dc4dade42f649f,2eed] [c.v.e.s.l.c.s.VmwareCompatibilityDataDownloadScheduler,vac-scheduler-1] VVS Compatibility Data update failed
  com.vmware.vcf.compatibility.controllers.internal.vvs.exception.VvsException: The VVS api call to https://vvs.esp.vmware.com/v1/products/bundles/type/vcf-lcm-v2-bundle?format=json failed. Response: Network is unreachable

Environment

VMware SDDC Manager 5.2.1

Cause

SDDC Manager is unable to download the VMwareCompatibilityData.json file due to network blocked. 

Resolution

To solve this issue, please work with your firewall team to allow access to the required public URLs for SDDC Manager, as are listed in Public URL list for VCF Products.

As a workaround you can also disable the upgrade compatibility checks temporarily, using the following steps:

1. SSH into SDDC Manager appliance with the vcf user and su to root.
2. Take a backup of the file /opt/vmware/vcf/lcm/lcm-app/conf/compatibility.flag
3. Edit the file and change the property vcf.compatibility.controllers.compatibilityCheckEnabled to false
4. Save and close the file.
5. Restart the Lifecycle Management by running the following command:

   # systemctl restart lcm

Note: Re-enable the compatibility checks once the upgrades are complete to ensure guardrails are in place with respect to Bill-of-Materials compatibility for future upgrades.