VM recompose tasks are stuck at 64%

Products

• VMware Cloud Director

Issue/Introduction

• A virtual machine (VM) recompose operation in VMware Cloud Director (VCD) has stalled at exactly 64%. The operation is unresponsive, preventing changes to the target vApp or VM construct from finalizing.
• vApps/VM's appear in "Partially Running" status.
• Tenant user is unable the perform any actions on the vApps/VM.
• VM actions menu is grayed out.
• vApps and VMs had just been created as part of custom automation script.

Environment

VMware Cloud Director 10.6.1.x

Resolution

To resolve this issue firstly confirm if there are any active tasks on the VMs at the vCenter Server layer. If none are found then the recompose tasks need to be stopped in VCD so the objects can return to a manageable state.

1. Login to vCenter Server and locate the VM(s) which have the task stuck at 64%. 
2. On the VM object navigate to Monitor > Tasks and inspect if there are any active tasks.
   1. If there is an active task, then monitor it until completion. The VCD task should resume once the vCenter task completes.
   2. If there are no tasks in vCenter, then proceed to step 3.
3. In the VCD Tenant UI click on the impacted VM object and navigate to the Tasks page.
4. Locate the task which is stuck and 64% and click the radio button beside it.
5. Click the Cancel button from the menu and wait for the task to stop.
6. If the running task fails to stop, proceed to use the fail-tasks command of the cell management tool on one cell in the cluster after shutting down the Cloud Director service on all Cells. Details on how to use the fail-tasks command are outlined in the Cloud Director documentation Update the Failure Status of a Task.