SDDC Manager upgrade prechecks fail with "Triggering SDDC Manager upgrade bundle failed" error in VCF Operations UI

Products

• VCF Operations

Issue/Introduction

• The Management components have already been successfully upgraded to version 9.1.1. (See documentation)
• In VCF Operations > Build > Lifecycle > <vcf_instance> the SDDC Manager 9.1.1 bundle is available for upgrade.
• Running a precheck fails with the red-banner error "Triggering SDDC Manager upgrade bundle failed. A problem has occurred on the server. Please retry or contact the service provider and provide the reference token."
• The /var/log/vmware/vcf/lcm/lcm-debug.log contains entries similar to:

YYYY-MM-DDTHH:MM:SS.MS+HH:MM DEBUG [vcf_lcm,c8bd46f940ac4ef0,9c1b] [c.v.v.l.r.a.c.v.a.AssessmentApiController,http-nio-###.#.#.#-7400-exec-10] [CheckSet POST] triggerCheckRun - Payload: {"queryId":"########-####-####-####-############","
resources":[{"resourceName":"<FQDN>","resourceId":"########-####-####-####-############","resourceType":"SDDC_MANAGER","domain":{"domainName":"vclmgt","domainType":"MANAGEMENT","domainId":"########-####-####-####-############"
},"checkSets":[{}]}],"metadata":{"targetVersion":"9.1.1.0.25713928"}}

.................

YYYY-MM-DDTHH:MM:SS.MS+HH:MM ERROR [vcf_lcm,c8bd46f940ac4ef0,9c1b] [c.v.v.l.r.a.c.v.a.AssessmentApiController,http-nio-###.#.#.#-7400-exec-10] [CheckSet POST] Failed to trigger prechecks due to unexpected error  com.vmware.evo.sddc.lcm.m
odel.error.LcmException: Failed to retrieve the VCF target version release for input spec CheckSetRunInputRest(queryId=########-####-####-####-############, resources=[ResourceSelectionInput(resourceName=<FQDN>, resourceId=5f8
352ad-28b5-472b-8665-8dc6f7fd5122, resourceType=SDDC_MANAGER, domain=<MASKED DOMAIN>, domainType=MANAGEMENT, domainId=########-####-####-####-############), checkSets=[]), ResourceSelectionInput(resourceName=vclmgt, reso
urceId=########-####-####-####-############, resourceType=DOMAIN, domain=<MASKED DOMAIN>, domainType=MANAGEMENT, domainId=########-####-####-####-############), checkSets=[])], metadata=AssessmentMetadata(targetVersion=9
.1.1.0.25713928, resources=null, upgradeId=null), contextVariables=null)
java.util.concurrent.CompletionException: com.vmware.evo.sddc.lcm.model.error.LcmException: Failed to retrieve the VCF target version release for input spec CheckSetRunInputRest(queryId=########-####-####-####-############, resources=[Re
sourceSelectionInput(resourceName=<FQDN>, resourceId=########-####-####-####-############, resourceType=SDDC_MANAGER, domain=<MASKED DOMAIN>, domainType=MANAGEMENT, domainId=########-####-####-####-ccd5bc46578
b), checkSets=[]), ResourceSelectionInput(resourceName=vclmgt, resourceId=########-####-####-####-############, resourceType=DOMAIN, domain=<MASKED DOMAIN>, domainType=MANAGEMENT, domainId=########-####-####-####-ccd5bc4
6578b), checkSets=[])], metadata=AssessmentMetadata(targetVersion=9.1.1.0.25713928, resources=null, upgradeId=null), contextVariables=null)
        at java.base/java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:315)
        at java.base/java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:320)

 

Environment

• Source VMware SDDC version: 9.1.0.0400
• Target VMware SDDC Version: 9.1.1

Cause

• The precheck backend of SDDC 9.1.0400 cannot parse 9.1.1.0.25713928 sent by the SDDC Manager decoupled UI.
• VMware by Broadcom is aware of this issue and it has been resolved in version 9.1.1

Resolution

Workaround for Prechecks

1. In the VCF Operations UI trigger the prechecks: Build > Lifecycle > Upgrades > VCF Instances > Select the desired domain > Upgrades > Run Prechecks
   
   

Workaround for Upgrades

1. In the VCF Operations UI trigger the SDDC Upgrade: Build > Lifecycle > Upgrades > VCF Instances > Select the desired domain > Upgrades > Plan Domain Upgrade or Plan Component Upgrade