Cluster compliance warning ""Health Check for '<ESXi fqdn>' failed"

Products

• VMware vCenter Server

Issue/Introduction

Constant task shown on vCenter UI relating to cluster image compliance check attempting to apply wcp solution. 

Tasks showing error "Health Check for '<ESXi host fqdn>' failed

Environment

VCF 9.0

Cause

Tracking in /var/log/vmware/vmware-updatemgr/vum-server/vmware-vum-server.log
We can see the task that is failing relates to wcp solution

 

1234.544Z info vmware-vum-server[] [Originator@6876 sub=ClusterApplySolutionTask] [Task,  Task:com.vmware.vcIntegrity.lifecycle.ClusterApplySolutionTask ID:<1234>. Finalizing Task
1234.574Z error vmware-vum-server[] [Originator@6876 sub=ClusterApplySolutionTask] [Task, ] Task:com.vmware.vcIntegrity.lifecycle.ClusterApplySolutionTask ID:<1234>. Task Failed. Error: Error:
-->    com.vmware.vapi.std.errors.error
--> Messages:
-->    com.vmware.vcIntegrity.lifecycle.TaskError.HealthCheckFailed<Health Check for '<ESXi host fqdn>' failed>
-->
1234.575Z warning vmware-vum-server[] [Originator@6876 sub=TaskStatsCollector] [] Task type or creation time not present
1234.575Z info vmware-vum-server[] [Originator@6876 sub=PM.AsyncTask.ClusterApplySolutionTask{}] [vciTaskBase 1493] SerializeToVimFault fault:
--> (vmodl.fault.SystemError) {
-->    faultCause = (vmodl.MethodFault) null,
-->    faultMessage = (vmodl.LocalizableMessage) [
-->       (vmodl.LocalizableMessage) {
-->          key = "com.vmware.vcIntegrity.lifecycle.TaskError.HealthCheckFailed",
-->          arg = (vmodl.KeyAnyValue) [
-->             (vmodl.KeyAnyValue) {
-->                key = "1",
-->                value = "<ESXi host fqdn>"
-->             }
-->          ],
-->          message = <unset>
-->       }
-->    ],
-->    reason = "vLCM Task failed, see Error Stack for details."
-->    msg = "{
-->     "data": null,
-->     "error_type": "ERROR",
-->     "messages": [
-->         {
-->             "args": [
-->                 "<ESXi host fqdn>"
-->             ],
-->             "default_message": "Health Check for '<esx fqdn>' failed",
-->             "id": "com.vmware.vcIntegrity.lifecycle.TaskError.HealthCheckFailed"
-->         }
-->     ]

 

1234.599Z info vmware-vum-server[] [Originator@sub=ClusterApplySolutionTask] [Task, ] Task:com.vmware.vcIntegrity.lifecycle.ClusterApplySolutionTask ID:<1234>. Task State updated to FAILED

 

Checking dcli for the cluster solutions we can confirm exists and error appears to be a false positive

dcli> esx settings depots offline list
   file_id: /storage/updatemgr/patch-store-temp/vsphere-wcp-depot-embedded.zip
   description: WCP offline bundle
   ownerdata: com.vmware.vsphere-wcp
   location:
   source_type: PUSH
   <depot id>:

dcli> esx settings depots offline content get --depot <depot id>
metadata_bundles:
   vmw:
      - hardware_support:
        addons:
        file_name: metadata-215.zip
        solutions:
          com.vmware.vsphere-wcp:
              components:
                 VMware_bootbank_spherelet_9.0.1.28.2.0-24522473:
                    release_date: xxxxxx
                    version:
                       display_version: 9.0.1.28.2.0
                       version: 9.0.1.28.2.0-24522473
                    vib_informations:
                       VMware_bootbank_spherelet_9.0.1.28.2.0-24522473:
                          software_tags:
                                   -ConfigSchema:spherelet-9.0.1.28.2.0-24522473:spherelet:usr/lib/vmware/configmanager/schemas/spherelet-9.0.1.28.2.0-24522473-schema.json
              versions:
               - display_version: 9.0.1.30.5.0-24526496
                   version: 9.0.1.30.5.0-24526496
               - display_version: 9.0.1.29.3.0-24522471
                   version: 9.0.1.29.3.0-24522471
               - display_version: 9.0.1.28.2.0-24522473
                   version: 9.0.1.28.2.0-24522473
              display_name: VMware vSphere with Kubernetes - Supervisor Cluster
        independent_components:
        base_images:
        updates:
           VMware_bootbank_spherelet_9.0.1.28.2.0-24522473:
              summary: Spherelet - An ESXi node agent for Kubernetes
           VMware_bootbank_spherelet_9.0.1.29.3.0-24522471:
              summary: Spherelet - An ESXi node agent for Kubernetes
           VMware_bootbank_spherelet_9.0.1.30.5.0-24526496:
              summary: Spherelet - An ESXi node agent for Kubernetes
           VMware_bootbank_spherelet_9.0.1.29.3.0-24522471:
              summary: Spherelet - An ESXi node agent for Kubernetes
           VMware_bootbank_spherelet_9.0.1.30.5.0-24526496:
              summary: Spherelet - An ESXi node agent for Kubernetes

 

 

 

Resolution

Rebooting vCenter resolves the issue.