VCF Stretched Cluster Expansion Fails with Error 'VSPHERE_SDDC_MANAGED_DISK_CLAIM_STATUS_CHECK_FAILED'

Products

• VMware SDDC Manager
• VMware Cloud Foundation

Issue/Introduction

• When expanding a stretched cluster in VMware Cloud Foundation (VCF), the task fails during the validation of vSAN ESA eligible disks. The following error is displayed in the SDDC Manager UI

          VSPHERE_SDDC_MANAGED_DISK_CLAIM_STATUS_CHECK_FAILED Cannot verify vSAN ESA Certified/Eligible disks claim status on cluster.

• The /var/log/vmware/vcf/domainmanager/domainmanager.log file contains the following exception:

  YYYY-MM-DDTHH:MM:SS.Z.329-0600 ERROR [vcf_dm,##############################,####] [c.v.e.s.o.model.error.ErrorFactory,dm-exec-##]  [######] VSPHERE_SDDC_MANAGED_DISK_CLAIM_STATUS_CHECK_FAILED Cannot verify vSAN ESA Certified/Eligible disks claim status on cluster CLUSTER-NAME.
  com.vmware.evo.sddc.orchestrator.exceptions.OrchTaskException: Cannot verify vSAN ESA Certified/Eligible disks claim status on cluster CLUSTER-NAME.
          at com.vmware.vcf.common.fsm.plugins.action.impl.VsanEsaSddcManagedDiskClaimAction.postValidate(VsanEsaSddcManagedDiskClaimAction.java:173)
          at com.vmware.vcf.common.fsm.plugins.action.impl.VsanEsaSddcManagedDiskClaimAction.postValidate(VsanEsaSddcManagedDiskClaimAction.java:43)
          at com.vmware.evo.sddc.orchestrator.platform.action.FsmActionState.lambda$static$1(FsmActionState.java:27)
          at com.vmware.evo.sddc.orchestrator.platform.action.FsmActionState.invoke(FsmActionState.java:66)
          at com.vmware.evo.sddc.orchestrator.platform.action.FsmActionPlugin.invoke(FsmActionPlugin.java:161)
          at com.vmware.evo.sddc.orchestrator.platform.action.FsmActionPlugin.invoke(FsmActionPlugin.java:147)
          at com.vmware.evo.sddc.orchestrator.core.ProcessingTaskSubscriber.invokeMethod(ProcessingTaskSubscriber.java:403)
          at com.vmware.evo.sddc.orchestrator.core.ProcessingTaskSubscriber.processTask(ProcessingTaskSubscriber.java:556)
          at com.vmware.evo.sddc.orchestrator.core.ProcessingTaskSubscriber.accept(ProcessingTaskSubscriber.java:128)
          at jdk.internal.reflect.GeneratedMethodAccessor1313.invoke(Unknown Source)
          at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
          at java.base/java.lang.reflect.Method.invoke(Method.java:569)
          at com.google.common.eventbus.Subscriber.invokeSubscriberMethod(Subscriber.java:85)
          at com.google.common.eventbus.Subscriber.lambda$dispatchEvent$0(Subscriber.java:71)
          at com.vmware.vcf.common.tracing.TraceRunnable.run(TraceRunnable.java:63)
          at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
          at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
          at java.base/java.lang.Thread.run(Thread.java:840)
  Caused by: com.vmware.evo.sddc.orchestrator.exceptions.OrchTaskException: Failed to verify vSAN ESA storage pool eligible disks claim status after 10 retries.

Environment

VMware Cloud Foundation 9.x

Resolution

• To resolve the issue add the following property "vsan.esa.sddc.managed.disk.claim=true" to /etc/vmware/vcf/domainmanager/application.properties:

1. Take a snapshot of the SDDC manager VM.
2. SSH into the SDDC manager with vcf and then elevate to root with su.
3. Add the following property "vsan.esa.sddc.managed.disk.claim=true" to /etc/vmware/vcf/domainmanager/application.properties
4. Restart the domainmanager service.

   systemctl restart domainmanager

5. Re-try the task.