Remediation failed for host where error is: "An error occurred while downloading VIB: 'http://<vc_fqdn>:9084/vum/repository/hostupdate/vmw/vib20/tools-light/VMware_locker_tools-light_12.5.3.24819

Products

• VMware vCenter Server

Issue/Introduction

• When attempting to remediate an ESXi host from version 8.0 to 9.0 using vSphere Lifecycle Manager (vLCM), the remediation task fails during image validation. The failure occurs while downloading a specific VIB (VMware Installation Bundle) component.
• The error during remediation is: "An error occurred while downloading VIB: 'http://<vc_fqdn>:9084/vum/repository/hostupdate/vmw/vib20/tools-light/VMware_locker_tools-light_12.5.3.24819"
• In the location: /var/log/vmware/vmware-updatemgr/vum-server/vum-server.log we get the below entries:
  
  

   warning vmware-vum-server[3173172] [Originator@6876 sub=TaskStatsCollector] [taskStatsCollector 190] Task type or creation time not present
   info vmware-vum-server[1228853] [Originator@6876 sub=PM.AsyncTask.RemediateClusterTask{52}] [vciTaskBase 1493] SerializeToVimFault fault:
  --> (vmodl.fault.SystemError) {
  -->    faultCause = (vmodl.MethodFault) null,
  -->    faultMessage = (vmodl.LocalizableMessage) [
  -->       (vmodl.LocalizableMessage) {
  -->          key = "com.vmware.vcIntegrity.lifecycle.RemediateClusterTask.HostApplyFailed",
  -->          arg = (vmodl.KeyAnyValue) [
  -->             (vmodl.KeyAnyValue) {
  -->                key = "1",
  -->                value = "<host-name>"
  -->             }
  -->          ],
  -->          message = <unset>
  -->       }
  -->    ],
  -->    reason = "vLCM Task failed, see Error Stack for details."
  -->    msg = "{
  -->     "data": null,
  -->     "error_type": "ERROR",
  -->     "messages": [
  -->         {
  -->             "args": [
  -->                 "<esxi_fqdn>"
  -->             ],
  -->             "default_message": "Remediation failed for Host '<esxi_fqdn>'",
  -->             "id": "com.vmware.vcIntegrity.lifecycle.RemediateClusterTask.HostAppl025- info vmware-vum-server[1228853] [Originator@6876 sub=RemediateClusterTask] [ApplyHelpers 1266] Updating status with failure. -originator = vSphere Lifecycle Manager - retriable = false
   info vmware-vum-server[1228853] [Originator@6876 sub=RemediateClusterTask] [RemediateClusterTask, 408] Task:com.vmware.vcIntegrity.lifecycle.RemediateClusterTask ID:#######-####-#######-#####.. RemediateClusterTask - FinalizeTaskResult - updating error status on current host(host-####).
  vmware-vum-server[1228853] [Originator@6876 sub=RemediateClusterTask] [ApplyHelpers 1266] Updating status with failure. -originator = vSphere Lifecycle Manager - retriable = false
  info vmware-vum-server[1228853] [Originator@6876 sub=RemediateClusterTask] [RemediateClusterTask, 295] Task:com.vmware.vcIntegrity.lifecycle.RemediateClusterTask ID:#######-####-#######-#####.. Fina
  lize host(=host-####)  status(=4)
  info vmware-vum-server[1228853] [Originator@6876 sub=RemediateClusterTask] [RemediateClusterTask, 479] Task:com.vmware.vcIntegrity.lifecycle.RemediateClusterTask ID:#######-####-#######-#####.. RemediateClusterTask - FinalizeTaskResult - remaining hosts set size : 0
  info vmware-vum-server[1228853] [Originator@6876 sub=RemediateClusterTask] [RemediateClusterTask, 322] Task:com.vmware.vcIntegrity.lifecycle.RemediateClusterTask ID:#######-####-#######-#####. Not
  updating the commitId since not all the hosts in the cluster were successfully remediated.
   error vmware-vum-server[1228853] [Originator@6876 sub=RemediateClusterTask] [Task, 424] Task:com.vmware.vcIntegrity.lifecycle.RemediateClusterTask ID:#######-####-#######-#####. Task Failed. 
  

 

Environment

VMware vCenter Server

Cause

This issue occurs when a custom component (in this case, tools-light) added to the ESXi image cannot be validated during remediation.

Resolution

        To resolve this remove the problematic component from the image specification. Steps to follow:

1. Edit the cluster image in vSphere Lifecycle Manager. For reference: Edit a vSphere Lifecycle Manager Image
2. Remove the tools-light or any recently added custom VIB/component.
3. Save and validate the image again.
4. Retry the remediation task after saving the modified image.