The VCF stretch cluster operation fails in the "Configure Fault Domains" task with the below exception
search cancel

The VCF stretch cluster operation fails in the "Configure Fault Domains" task with the below exception

book

Article ID: 316520

calendar_today

Updated On:

Products

VMware Cloud Foundation

Issue/Introduction

Symptoms:
Below Exception in domain manager log file

2022-06-09T23:51:00.113+0000 WARN  [vcf_dm,0000000000000000,0000] [c.v.v.v.c.h.i.HttpConfigurationCompilerBase$ConnectionMonitorThreadBase,VLSI-client-connection-monitor-2717]  Interrupted, no more connection pool cleanups will be performed.
2022-06-09T23:51:00.113+0000 ERROR [vcf_dm,1f2a408b60e34d79,396c] [c.v.e.s.o.model.error.ErrorFactory,dm-exec-1]  [J4I6LP] VSAN_FAULTDOMAIN_CONFIG_FAILED Failed to configure fault domains in cluster cluster01 in vCenter vcenter.domain.local
com.vmware.evo.sddc.orchestrator.exceptions.OrchTaskException: Failed to configure fault domains in cluster cluster01 in vCenter vcenter.domain.local
 at com.vmware.vcf.common.contract.fsm.actions.impl.BaseConfigureVsanFault
 DomainsAction.configureFaultDomains(BaseConfigureVsanFaultDomainsAction.java:86)
 at com.vmware.evo.sddc.stretchclustermanager.tasks.ConfigureVsanStretchCluster
 Action.execute(ConfigureVsanStretchClusterAction.java:50)
 at com.vmware.evo.sddc.stretchclustermanager.tasks.ConfigureVsanStretch
 ClusterAction.execute(ConfigureVsanStretchClusterAction.java:20)
 at com.vmware.evo.sddc.orchestrator.platform.action.FsmActionState.
 invoke(FsmActionState.java:62)
 at com.vmware.evo.sddc.orchestrator.platform.action.FsmActionPlugin.
 invoke(FsmActionPlugin.java:159)
 at com.vmware.evo.sddc.orchestrator.platform.action.FsmActionPlugin.
 invoke(FsmActionPlugin.java:144)
 at com.vmware.evo.sddc.orchestrator.core.ProcessingTaskSubscriber.
 invokeMethod(ProcessingTaskSubscriber.java:400)
 at com.vmware.evo.sddc.orchestrator.core.ProcessingTaskSubscriber.
 processTask(ProcessingTaskSubscriber.java:520)
 at com.vmware.evo.sddc.orchestrator.core.ProcessingTaskSubscriber.
 accept(ProcessingTaskSubscriber.java:124)
 at sun.reflect.GeneratedMethodAccessor520.invoke(Unknown Source)
 at sun.reflect.DelegatingMethodAccessorImpl.invoke
 (DelegatingMethodAccessorImpl.java:43)
 at java.lang.reflect.Method.invoke(Method.java:498)
 at com.google.common.eventbus.Subscriber.invokeSubscriberMethod(Subscriber.java:87)
 at com.google.common.eventbus.Subscriber$1.run(Subscriber.java:72)
 at org.springframework.cloud.sleuth.instrument.async.TraceRunnable.run
 (TraceRunnable.java:67)
 at org.springframework.cloud.sleuth.instrument.async.TraceRunnable.run
 (TraceRunnable.java:67)
 at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
 at java.lang.Thread.run(Thread.java:748)
Caused by: com.vmware.evo.sddc.common.client.vmware.vsphere.VsphereOperationException: (vmodl.fault.InvalidArgument) {
   faultCause = null,
   faultMessage = (vmodl.LocalizableMessage) [
      com.vmware.vim.binding.impl.vmodl.LocalizableMessageImpl@7465c470
   ],
   invalidProperty = null
}
 at com.vmware.evo.sddc.common.client.vmware.vsan.VsanManagerBase.
 configureVsanFaultDomainsInCluster(VsanManagerBase.java:1305)
 at com.vmware.vcf.common.contract.fsm.actions.impl.BaseConfigureVsanFault
 DomainsAction.configureFaultDomains(BaseConfigureVsanFaultDomainsAction.java:73)
 ... 18 common frames omitted
Caused by: com.vmware.vim.binding.vmodl.fault.InvalidArgument: null
 at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
 at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessor
 Impl.java:62)
 at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructor
 AccessorImpl.java:45)
 at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
 at java.lang.Class.newInstance(Class.java:442)
 at com.vmware.vim.vmomi.core.types.impl.ComplexTypeImpl.newInstance
 (ComplexTypeImpl.java:174)
 at com.vmware.vim.vmomi.core.types.impl.DefaultDataObjectFactory.newDataObject
 (DefaultDataObjectFactory.java:25)
 at com.vmware.vim.vmomi.core.soap.impl.unmarshaller.ComplexStackContext.
 <init>(ComplexStackContext.java:30)
 at com.vmware.vim.vmomi.core.soap.impl.unmarshaller.UnmarshallerImpl$UnmarshallSoap
 FaultContext.parse(UnmarshallerImpl.java:150)
 at com.vmware.vim.vmomi.core.soap.impl.unmarshaller.UnmarshallerImpl$UnmarshallSoap
 FaultContext.unmarshall(UnmarshallerImpl.java:101)
 at com.vmware.vim.vmomi.core.soap.impl.unmarshaller.UnmarshallerImpl.unmarshalSoap
 Fault(UnmarshallerImpl.java:88)
 at com.vmware.vim.vmomi.core.soap.impl.unmarshaller.UnmarshallerImpl.unmarshal
 SoapFault(UnmarshallerImpl.java:83)
 at com.vmware.vim.vmomi.client.common.impl.SoapFaultStackContext.
 setValue(SoapFaultStackContext.java:40)
 at com.vmware.vim.vmomi.client.common.impl.ResponseUnmarshaller.processNext
 Element(ResponseUnmarshaller.java:127)
 at com.vmware.vim.vmomi.client.common.impl.ResponseUnmarshaller.
 unmarshal(ResponseUnmarshaller.java:70)
 at com.vmware.vim.vmomi.client.common.impl.ResponseImpl.unmarshal
 Response(ResponseImpl.java:272)
 at com.vmware.vim.vmomi.client.common.impl.ResponseImpl.set
 Response(ResponseImpl.java:229)
 at com.vmware.vim.vmomi.client.http.impl.HttpExchangeBase.parse
 Response(HttpExchangeBase.java:150)
 at com.vmware.vim.vmomi.client.http.impl.HttpExchange.run(HttpExchange.java:48)
 at com.vmware.vim.vmomi.client.http.impl.HttpProtocolBindingBase.execute
 Runnable(HttpProtocolBindingBase.java:226)
 at com.vmware.vim.vmomi.client.http.impl.HttpProtocolBindingImpl.
 send(HttpProtocolBindingImpl.java:109)
 at com.vmware.vim.vmomi.client.common.impl.MethodInvocationHandlerImpl$
 CallExecutor.sendCall(MethodInvocationHandlerImpl.java:581)
 at com.vmware.vim.vmomi.client.common.impl.MethodInvocationHandlerImpl$
 CallExecutor.executeCall(MethodInvocationHandlerImpl.java:562)
 at com.vmware.vim.vmomi.client.common.impl.MethodInvocationHandlerImpl.complete
 Call(MethodInvocationHandlerImpl.java:344)
 at com.vmware.vim.vmomi.client.common.impl.MethodInvocationHandlerImpl.
 invokeOperation(MethodInvocationHandlerImpl.java:304)
 at com.vmware.vim.vmomi.client.common.impl.MethodInvocationHandlerImpl.
 invoke(MethodInvocationHandlerImpl.java:178)
 at com.sun.proxy.$Proxy428.convertToStretchedCluster(Unknown Source)
 at com.vmware.evo.sddc.common.client.vmware.vsan.VsanManagerBase.configure
 VsanFaultDomainsInCluster(VsanManagerBase.java:1282)
 ... 19 common frames omitted


Also, the manual addition of witness host to the stretched cluster would display "Witness part of another vSAN cluster" as error in the vCenter.

Environment

VMware Cloud Foundation 3.x
VMware Cloud Foundation 4.x

Cause

The witness host is not deployed/configured correctly in the vCenter.

Resolution

Redeploy the new witness host, configure it correctly as mentioned in the VCF admin guide, and register with the parent vCenter for the cluster being stretched.

Workaround:
Workaround is not applicable.