Configuration Upgrade fails to configure the vSAN HA network isolation address

Products

• VCF Operations

Issue/Introduction

• The 'Apply Configuration Upgrade' workflow fails when trying to configure the vSAN HA network isolation address
• Error seen is "Configure High Availability Isolation Address(es) failed for Cluster <cluster_name>'
• /var/log/vmware/vcf/domainmanager/domainmanager.log on the SDDC Manager contain entries similar to:

###-##-##T11:18:48.207+0000 ERROR [vcf_dm,6a3a6b96b560398a4345a6a2764165f4,f652] [c.v.e.s.o.model.error.ErrorFactory,dm-exec-2612]  [J2SK9U] VSPHERE_HA_ISOLATION_ADDRESS_OPTIONS_CONFIGURATION_FAILED Configure High Availability Isolation
 Address(es) failed for Cluster <domain_managed_object_name>
com.vmware.evo.sddc.orchestrator.exceptions.OrchTaskException: Configure High Availability Isolation Address(es) failed for Cluster <domain_managed_object_name>
        at com.vmware.vcf.common.contract.fsm.actions.impl.BaseHaIsolationAddressOptionsAction.configureHaIsolationAddress(BaseHaIsolationAddressOptionsAction.java:115)

Caused by: com.vmware.evo.sddc.common.client.vmware.vsphere.VsphereOperationException: Task: (MOR:task-2353127) (Name:reconfigureEx) Entity: (MOR:<domain_managed_object_name>) (Name:<domain_name>) is failed
        at com.vmware.evo.sddc.common.client.vmware.vsphere.VcManagerBase.processTaskInfo(VcManagerBase.java:14244)
        at com.vmware.evo.sddc.common.client.vmware.vsphere.VcManagerBase.waitForTask(VcManagerBase.java:14139)

Caused by: com.vmware.vim.binding.vmodl.fault.InvalidArgument: A specified parameter was not correct:
        at java.base/jdk.internal.reflect.DirectConstructorHandleAccessor.newInstance(DirectConstructorHandleAccessor.java:62)

Environment

VCF 9.1.x

Resolution

• Log in to the vCenter of the workload domain for which the config upgrade has failed.
• For each cluster of that workload domain in the vCenter, remove all high availability isolation addresses by navigating to the cluster > Configure > vSphere Availability > Advanced Options. The isolation addresses will have a property key like "das.isolationaddress<a number between 0 and 9>"
• Retry the Configuration upgrade.