vCenter Upgrade Failed With Error: Failed to run vdcpromo

Products

• VMware Cloud Foundation

Issue/Introduction

Symptoms:

vCenter upgrade failed with the below error from SDDC

Please retry the upgrade once the upgrade is available again. FAILED TASK : com.vmware.vcsa.installer.monitor.monitor_vcsa_deployment
default message : Failed to run vdcpromo
: com.vmware.evo.sddc.lcm.primitive.impl.vcenter.upgrade.input.VC70.status.Resolution@3d1fc373[id=,args=[],defaultMessage=Please search of these symptoms in the VMware Knowledge Base for any known issues and possible workarounds. If none can be found, please collect a support bundle and open a support request.]

default message : Error:
Problem Id: install.vmafd.vmdir_vdcpromo_error
Component key: vmafd

Details:

Failed to run vdcpromo
Resolution: Please search of these symptoms in the VMware Knowledge Base for any known issues and possible workarounds. If none can be found, please collect a support bundle and open a support request.
: com.vmware.evo.sddc.lcm.primitive.impl.vcenter.upgrade.input.VC70.status.Resolution@1d33b48b[id=,args=[],defaultMessage=]
default message : The VCSA deployment has failed
VCSA Deployment Start Time: 2022-11-30T15:59:28.695Z
VCSA Deployment End Time: 2022-11-30T16:13:47.142Z

 

VMAFD first boot failed:

Cause

PSCs/VMDIR replication issues for node(s) in the SSO domain:

Resolution

1. Revert the snapshots for all the nodes back to working state 
2. Find healthy PSC to be used, this PSC have to have VMDIR in normal state and no replica broken with partners same as the below output   

      3. Run fixpsc from the impacted node, the one that have VMDIR in read only and/or replica broken

      4. Check VMDIR and replica again on all the nodes to make sure all good, then retry the upgrade but make sure to delete the target failed vCenter if it is not needed anymore 

 

 

Additional Information

Notes:

The script might fail when starting services, reboot the node should solve this issue      

VMDIR logs are not logging any messages in its log file, the below KB solves that issue

rsyslog stops logging to vmdird and messages in vCenter Server 7.0

 

Impact/Risks:

 

This is a blocker to upgrade vCenter