Error: "The vSphere object is unknown to VMware Cloud Director" when creating a VM

Products

• VMware Cloud Director

Issue/Introduction

• Creating a VM fails with the error:
  
  [########-####-####-########6940] The vSphere object [vcId=########-####-####-########02a4, moref=datastore-##] is unknown to VMware Cloud Director.


• In /opt/vmware/vcloud-director/logs/vcloud-container-debug.log the following entry can be seen:
  
  DATE TIME | ERROR    | task-service-activity-pool-189 | FutureUtil                     | Task future is not complete. | requestId=########-####-####-########6940,request=POST https://cloud.example.com/api/vdc/########-####-####-########e95c/action/instantiateVmFromTem...,requestTime=1741886548457,remoteAddress=##.##.##.##:39924,userAgent=Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 ...,accept=application/*+xml;version 39.0 vcd=########-####-####-########db84,task=########-####-####-########c674 activity=(com.vmware.vcloud.backendbase.management.system.TaskActivity,urn:uuid:########-####-####-########c674)
com.vmware.ssdc.util.LMException: The vSphere object [vcId=########-####-####-########02a4, moref=datastore-74] is unknown to VMware Cloud Director.
[....]
Caused by: com.vmware.vcloud.api.presentation.service.BadRequestException: The vSphere object [vcId=########-####-####-########02a4, moref=datastore-##] is unknown to VMware Cloud Director.

  AND
  
  DATE TIME  | ERROR    | task-service-activity-pool-1465 | FutureUtil                     | Task future is not complete. | requestId=########-####-####-########6940, request=POST https://cloud.example.com/api/vdc/########-####-####-########3c4d/action/instantiateVmFromTemplate,requestTime=1741773544939,remoteAddress=##.##.##.##:58862,userAgent=Jetty/9.4.51.v20230217,accept=application/*+json;version 39.0 vcd=########-####-####-########bcf4,task=########-####-####-########8fa2 activity=(com.vmware.vcloud.backendbase.management.system.TaskActivity,urn:uuid:########-####-####-########98fa2)
com.vmware.ssdc.util.LMException: Internal Server Error
        at com.vmware.ssdc.util.LMException.wrap(LMException.java:135)
        at com.vmware.ssdc.library.ExceptionFactory.createFromMultiple(ExceptionFactory.java:32)
        at com.vmware.vcloud.vdc.impl.ComposeRecomposeVAppActivity$FinalizeRecomposePhase.invoke(ComposeRecomposeVAppActivity.java:1565)
        at com.vmware.vcloud.activity.executors.ActivityRunner.runPhase(ActivityRunner.java:175)
        at com.vmware.vcloud.activity.executors.ActivityRunner.run(ActivityRunner.java:112)
        at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
        at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
        at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
        at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
        at java.base/java.lang.Thread.run(Thread.java:829)
  
  
• The datastore listed in the error is not part of any storage policy used in VMware Cloud Director (VCD).
• The datastore listed in the error is not listed on the storage containers on the VCD provider UI.
• The datastore listed in the error is not listed in any table of the VCD DB.
• When browsing the datastore listed in the error in vCenter (VC), no tag has been assigned to it.

Environment

VMware Cloud Director 10.6.1

Cause

VC listener failed to update the datastore information in VCD database.

Resolution

Workaround

Reconnect a vCenter Server Instance to Your VMware Cloud Director