Unable to fetch available upgrades after a workload domain is removed

Products

• VMware Cloud Foundation

Issue/Introduction

Symptoms:
a) A Workload domain is removed by running "Delete Domain" option via SDDC Manager UI.
b) Another domain is selected for viewing / scheduling available upgrades.
c) SDDC Manager UI does not show available upgrades.
d) Following error is observed in LCM debug log

2021-10-07T16:37:50.804+0000 DEBUG [vcf_lcm,7e55e4151a5368a0,e8b3] [c.v.e.s.l.s.i.InventoryUpgradeServiceImpl,http-nio-127.0.0.1-7400-exec-3] compatibilitySetUnderCheck: compatibility for bundle-id VXRAIL7-0-100-26719865DL100842_VxRail-7-0-100-Composite-Upgrade-Slim-Package-for-7-0-x-zip - compatibility 7.0.0.10600-16620007:7.0.1-16850804:3.0.1.0.0-16404613
2021-10-07T16:37:50.804+0000 ERROR [vcf_lcm,7e55e4151a5368a0,e8b3] [c.v.e.s.l.a.r.c.i.u.InventoryUpgradeController,http-nio-127.0.0.1-7400-exec-3] In InventoryUpgradeController, Exception in getting all inventory upgrades
java.lang.NullPointerException: null
        at com.vmware.evo.sddc.lcm.services.impl.
InventoryUpgradeServiceImpl.getMinVcenterVersionFor(InventoryUpgradeServiceImpl.java:2392)
        at com.vmware.evo.sddc.lcm.services.impl.
InventoryUpgradeServiceImpl.doesBundleUpdate
ResultIntoInvalidState(InventoryUpgradeService
Impl.java:2080)
        at com.vmware.evo.sddc.lcm.services.impl.
InventoryUpgradeServiceImpl.lambda$null$7(InventoryUpgradeServiceImpl.java:1706)
        at java.util.HashMap.forEach
(HashMap.java:1289)
        at com.vmware.evo.sddc.lcm.services.impl.
InventoryUpgradeServiceImpl.lambda$update
PartnerSoftwareUpgradesBasedonCompatibility$8(InventoryUpgradeServiceImpl.java:1702)
        at java.util.HashMap.forEach(HashMap.
java:1289)
        at com.vmware.evo.sddc.lcm.services.impl.
InventoryUpgradeServiceImpl.updatePartner
SoftwareUpgradesBasedonCompatibility
(InventoryUpgradeServiceImpl.java:1699)
        at com.vmware.evo.sddc.lcm.services.impl.InventoryUpgradeServiceImpl.findAllPartnerSoftwareUpgrades(InventoryUpgradeServiceImpl.java:1538)
        at com.vmware.evo.sddc.lcm.api.rest.controller.inventory.upgrade.InventoryUpgradeController.getUpgrades(InventoryUpgradeController.java:89)
        at sun.reflect.GeneratedMethodAccessor270.invoke(Unknown Source)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)

Environment

VMware Cloud Foundation 4.0.x
VMware Cloud Foundation 3.0.x

Cause

The error is due to an issue with syncing updated inventory to LCM following a workload domain deletion operation.

Resolution

Currently there is no resolution.

Workaround:

Follow the below steps:

• Login to SDDC Manager via SSH and switch to root.
• Run following command to restart LCM. 

servicesystemctl restart lcm

• Wait for LCM service is restart.
• Run following command to verify LCM service is up 

systemctl status lcm

• Refresh SDDC Manager UI browser window