Unable to manage UNKNOWN VM in VMware Cloud Director

Products

• VMware Cloud Director
• VMware Telco Cloud Infrastructure

Issue/Introduction

• Unable to remove vApps in VMware Cloud Director(VCD), VM(s) are in an UNKNOWN state.
• VMs already deleted in vCenter Server, cannot remove from VCD.
• An import of a VM from vCenter failed, now the VMs cannot be removed from VCD.
• As the VM is displaying an 'UNKNOWN' status in the VCD UI, all of its power and management options are currently greyed out.
• After trying to remove a virtual machine from Management in Cloud Director you find the VM is in unknown status in VCD UI. 
• You can have VMware Cloud Director Availability(VCDA) replication created to migrate VMs but when the replications were deleted, it would not delete the replication from destination site. 
• Issue with deleting VAPP and VMs and you will get the below error message:
  Error deleting virtual machine "<Name of Virtual Machine" from vCenter Server.
 - Error deleting virtual machine [vcId= <vc_id>, moref=vm-<morefID>].
 - Task failed, vc-id={ <vc_id>}, task-moref={ManagedObjectReference: type = Task, value = task-<task-id>, serverGuid = null}, error={Invalid virtual machine state.}
 - The operation could not be performed because the object is in an invalid state.

Environment

• VMware Cloud Director 10.6.x

Cause

• This issue occurs when the VMs were deleted directly in vCenter and VCD cannot verify the state of the VM in vCenter.
• This issue can also happen if the VMs have not been imported correctly into VCD UI.

Resolution

• To resolve this issue, contact Broadcom Technical Support and note this Knowledge Article ID (371530) in the problem description. For more information, see How to Submit a Support Request