"Cannot find vSphere HA master agent" error on clusters post vCenter patching due to Sync Updates failure.
search cancel

"Cannot find vSphere HA master agent" error on clusters post vCenter patching due to Sync Updates failure.

book

Article ID: 436294

calendar_today

Updated On:

Products

VMware vSphere ESXi

Issue/Introduction

  • Post vCenter patching, Unable to enable HA on clusters. Errors seen: "vCenter Server is unable to find a master vSphere HA agent in cluster". "Insufficient vSphere HA failover resources."

  • Reconfiguring vSphere HA fails with the error "Setting desired image spec for cluster failed"


/var/log/vmware/vmware-updatemgr/vum-server/vmware-vum-server.log 

YYYY-MM-DDTHH:MM:SS info vmware-vum-server[11199] [Originator@6876 sub=com.vmware.vcIntegrity.lifecycle.SetSolutionTask] [SetSolutionTask 169] HA depot is not load yet
YYYY-MM-DDTHH:MM:SS error vmware-vum-server[11199] [Originator@6876 sub=com.vmware.vcIntegrity.lifecycle.SetSolutionTask] [SetSolutionTask 184] Failed to set solution on domain-####. Reason: HA depot not loaded yet.

...
YYYY-MM-DDTHH:MM:SS info vmware-vum-server[11199] [Originator@6876 sub=PM.AsyncTask.SetSolutionTask{2550}] [vciTaskBase 1496] SerializeToVimFault fault:

--> (vmodl.fault.SystemError) {
-->    faultCause = (vmodl.MethodFault) null, 
-->    faultMessage = (vmodl.LocalizableMessage) [
-->       (vmodl.LocalizableMessage) {
-->          key = "com.vmware.vcIntegrity.lifecycle.SetSolutionTask.Failed", 
-->          arg = <unset>, 
-->          message = <unset>
-->       }
-->    ], 
-->    reason = "vLCM Task failed, see Error Stack for details."
-->    msg = "{
-->     "data": null,
-->     "error_type": "ERROR",
-->     "messages": [
-->         {
-->             "args": [],
-->             "default_message": "Setting solution for image failed.",
-->             "id": "com.vmware.vcIntegrity.lifecycle.SetSolutionTask.Failed"
-->         }
-->     ]
--> }"
--> }

  • Attempting to perform a Sync Update on vSphere Lifecycle Manager generates an error "integrity.fault.MetadataDownloadFailure: Cannot download patch definitions."

/var/log/vmware/vmware-updatemgr/vum-server/vmware-vum-server.log: 


YYYY-MM-DDTHH:MM:SS error vmware-vum-server[11169] [Originator@6876 sub=VciSigUpdateTask.SigUpdateTask{19}] [vciSigUpdateTask 439] Error downloading thirdparty patches from :https://dl.broadcom.com/#/PROD/COMP/ESX_HOST/vmtools-main/vmw-depot-index.xml: no element found
YYYY-MM-DDTHH:MM:SS error vmware-vum-server[11169] [Originator@6876 sub=VciSigUpdateTask.SigUpdateTask{19}] [vciSigUpdateTask 559] \n\nError downloading third party patches from :https://dl.broadcom.com/#/PROD/COMP/ESX_HOST/main/vmw-depot-index.xml: no element found\n\nError downloading third party patches from :https://dl.broadcom.com/#/PROD/COMP/ESX_HOST/iovp-main/vmw-depot-index.xml: no element found\n\nError downloading third party patches from :https://dl.broadcom.com/#/PROD/COMP/ESX_HOST/vmtools-main/vmw-depot-index.xml: no element found
YYYY-MM-DDTHH:MM:SSerror vmware-vum-server[11169] [Originator@6876 sub=VciSigUpdateTask.SigUpdateTask{19}] [vciSigUpdateTask 559] [backtrace begin] product: VMware Update Manager, version: 8.0.3, build: build-25197330, tag: vmware-vum-server, cpu: x86_64, os: linux, buildType: release
--> backtrace[00] libvmacore.so[0x00531D35]]
--> backtrace[01] libvmacore.so[0x0042185E] Vmacore::System::Stacktrace::CaptureFullWork(unsigned int)
--> backtrace[02] libvmacore.so[0x0043403D] Vmacore::System::SystemFactory::CreateBacktrace(Vmacore::Ref<Vmacore::System::Backtrace>&)
--> backtrace[03] libvci-vcIntegrity.so[0x008B7B26] Integrity::VciSigUpdateTask::DownloadHostUpdate20Metadata()
--> backtrace[04] libvci-vcIntegrity.so[0x008B9B8C] Integrity::VciSigUpdateTask::DoRun()
--> backtrace[05] libvci-vcIntegrity.so[0x008C2F71] Integrity::VciTaskBase::Run()
--> backtrace[06] libvmacore.so[0x0037EC04]]
--> backtrace[07] libvmacore.so[0x00384517]]
--> backtrace[08] libvmacore.so[0x00510F31]]
--> backtrace[09] libpthread.so.0[0x00008EB0]]
--> backtrace[10] libc.so.6[0x000FFADF]]
--> backtrace[11] (no module)
--> [backtrace end]
YYYY-MM-DDTHH:MM:SS error vmware-vum-server[11169] [Originator@6876 sub=VciSigUpdateTask.SigUpdateTask{19}] [vciSigUpdateTask 576] Download 4.x host update: \n\nError downloading third party patches from :https://dl.broadcom.com/#/PROD/COMP/ESX_HOST/main/vmw-depot-index.xml: no element found\n\nError downloading third party patches from :https://dl.broadcom.com/#/PROD/COMP/ESX_HOST/iovp-main/vmw-depot-index.xml: no element found\n\nError downloading third party patches from :https://dl.broadcom.com/#/PROD/COMP/ESX_HOST/vmtools-main/vmw-depot-index.xml: no element found
YYYY-MM-DDTHH:MM:SS error vmware-vum-server[11169] [Originator@6876 sub=VciSigUpdateTask.SigUpdateTask{19}] [vciSigUpdateTask 766] Task failed with fault: integrity.fault.MetadataDownloadFailure
..
..
YYYY-MM-DDTHH:MM:SS error vmware-vum-server[12907] [Originator@6876 sub=com.vmware.vcIntegrity.lifecycle.SyncDepotsTask] [Task, 524] Task:com.vmware.vcIntegrity.lifecycle.SyncDepotsTask ID:522c5e53-4b5f-#######. Task Failed. Error: Error:
-->    com.vmware.vapi.std.errors.error
--> Messages:
-->    com.vmware.vcIntegrity.lifecycle.depots.sync.VciSigUpdateTaskErrorInfo<Download patch definitions task failed while syncing depots. Error: 'integrity.fault.MetadataDownloadFailure: Cannot download patch definitions. 
--> .'.>
--> 
YYYY-MM-DDTHH:MM:SS warning vmware-vum-server[11134] [Originator@6876 sub=TaskStatsCollector] [taskStatsCollector 190] Task type or creation time not present
YYYY-MM-DDTHH:MM:SS info vmware-vum-server[12907] [Originator@6876 sub=PM.AsyncTask.SyncDepotsTask{17}] [vciTaskBase 1496] SerializeToVimFault fault:
--> (vmodl.fault.SystemError) {
-->    faultCause = (vmodl.MethodFault) null, 
-->    faultMessage = (vmodl.LocalizableMessage) [
-->       (vmodl.LocalizableMessage) {
-->          key = "com.vmware.vcIntegrity.lifecycle.depots.sync.VciSigUpdateTaskErrorInfo", 
-->          arg = (vmodl.KeyAnyValue) [
-->             (vmodl.KeyAnyValue) {
-->                key = "1", 
-->                value = "integrity.fault.MetadataDownloadFailure: Cannot download patch definitions."
-->             }
-->          ], 
-->          message = <unset>
-->       }
-->    ], 
-->    reason = "vLCM Task failed, see Error Stack for details."
-->    msg = "{
-->     "data": null,
-->     "error_type": "ERROR",
-->     "messages": [
-->         {
-->             "args": [
-->                 "integrity.fault.MetadataDownloadFailure: Cannot download patch definitions. \n."
-->             ],
-->             "default_message": "Download patch definitions task failed while syncing depots. Error: 'integrity.fault.MetadataDownloadFailure: Cannot download patch definitions. \n.'.",
-->             "id": "com.vmware.vcIntegrity.lifecycle.depots.sync.VciSigUpdateTaskErrorInfo"
-->         }
-->     ]
--> }"

Environment

vSphere 8.x

Cause

There is an underlying corruption or configuration fault within the configured patch Depots or the Update Manager (vLCM) database.

Resolution

This issue can be resolved by resetting the Update Manager Database:

Resetting the VMware Update Manager Database

Post resetting the DB, Re-configure the official Broadcom URLs within the patch settings.

Initiate a manual sync update task.

Once the sync update successfully completes, Reconfigure vSphere HA on all the clusters - https://knowledge.broadcom.com/external/article/343224/disabling-and-enabling-vmware-high-avail.html  

Powered by Wolken Software