"Some of the disks of the virtual machine failed to load" after an unsuccessful backup operation

Products

• VMware vSphere ESXi

Issue/Introduction

• The virtual machines have the following warning:
  Some of the disks of the virtual machine failed to load.


• The backup operation fails with the below error: 
  Failed to fetch the virtual machine disks.
  
  
• The virtual machine has an ISO attached.
  
  This can be validated as follows:
  1. Right-click the desired virtual machine in the inventory and select Edit Settings.
  2. In the Virtual Machine Properties window, navigate to the CD/DVD drive (often listed as CD/DVD Drive 1).
  3. Check the details in the right pane. It should list "Datastore ISO File" and the full path to the .iso file if one is attached.
  4. Ensure the "Connected" or "Connect At Power On" checkbox is selected for the guest OS to access it.
     
     
• Virtual machine disk file size shows 0. This can be validated using the same procedure outlined above.

Environment

VMware vCenter Server 8.x
VMware vSphere ESXi 8.x

Cause

While virtual machines consist of multiple files, the ESXi host service (hostd) processes it as a single object. Should any of the virtual machine's child items become inaccessible, the virtual machine will transition into an invalid load state.

For example, if an ISO has been attached to a virtual machine and that ISO was moved away from the datastore; or was deleted without removing it from the virtual machine beforehand, the virtual machine will experience the issues described.

Furthermore, when the datastore that the virtual machine is located on becomes inaccessible, hostd will not refresh the disk. Default entries with 0 capacity will be generated for those virtual disks that were not yet cached. In this situation, hostd will not refresh the snapshot list for the virtual machine. As a result, snapshot creation tasks will fail. The snapshot itself is actually getting created, but the system fails to find the new UUID in the list, resulting in the task failing.

Resolution

Ideally in this scenario, if there is a need to keep the ISO attached to the virtual machine, the datastore containing the ISO should be available to the ESXi.

One of the following actions can be performed to mitigate this warning. 

1. Remove the .ISO file from the virtual machine.
   
   
2. Also try to vMotion the virtual machine to an ESXi host where the datastore is accessible. 
   
   
3. Mount the datastore to the ESXi host where the virtual machine is present at the time of the issue.
   
   
4. Resolve if there is any underlying issue with storage.

After performing the above action, and confirming the virtual machine is powered off, please follow the below steps to re-register the virtual machine.

1. Launch the vSphere Client and log in with the appropriate credentials.

2. Navigate to the desired ESXi host (or use the VMs and Templates view).

3. Right-click on the virtual machine and select Remove from Inventory (Note: If you are logged directly into the ESXi host client rather than vCenter, this option is called Unregister).

4. Navigate to the Storage view from the main menu, OR select your ESXi host and click the Datastores tab.

5. Select the appropriate datastore where the VM resides, and click the Files tab (Alternatively, right-click the datastore and select Browse Files).

6. Locate and open the virtual machine's directory folder.

7. Find the corresponding .vmx file.

8. Right-click the .vmx file and select Register VM.

9. Follow the registration wizard to complete the process (you will be prompted to confirm the VM name, select a compute resource, and complete the setup).

The warning should be gone now and backup should work as expected.