Upgrading vCenter from 7.x to 8.x fails during pre-check with error: Source vSphere ESX Agent Manager (EAM) upgrade failed to obtain EAM URLs to check against trusted certificates by the System!

Products

• VMware vCenter Server

Issue/Introduction

• Upgrading vCenter fails during stage 2 pre-check 

• /var/log/vmware/eam/eam.log

2024-09-25T05:08:18.780Z | ERROR | vlsi | DispatcherImpl.java | 468 | Internal server error during dispatch
com.vmware.vim.binding.eam.fault.EamServiceNotInitialized: EAM is still loading from database. Please try again later.
        at com.vmware.eam.vmomi.EAMInitRequestFilter.handleBody(EAMInitRequestFilter.java:57) ~[eam-server.jar:?]
        at com.vmware.vim.vmomi.server.impl.DispatcherImpl$SingleRequestDispatcher.handleBody(DispatcherImpl.java:373) [vlsi-server.jar:?]
        at com.vmware.vim.vmomi.server.impl.DispatcherImpl$SingleRequestDispatcher.dispatch(DispatcherImpl.java:290) [vlsi-server.jar:?]
        at com.vmware.vim.vmomi.server.impl.DispatcherImpl.dispatch(DispatcherImpl.java:246) [vlsi-server.jar:?]
        at com.vmware.vim.vmomi.server.http.impl.CorrelationDispatcherTask.run(CorrelationDispatcherTask.java:58) [vlsi-server.jar:?]
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_321]
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_321]
        at java.lang.Thread.run(Thread.java:748) [?:1.8.0_321]
2024-09-25T05:08:21.515Z |  INFO | vim-async-2 | OpIdLogger.java | 43 | [vim:loginExtensionByCertificate:e9d36f9bd8de9db5] Failed.
2024-09-25T05:08:21.515Z |  WARN | vim-async-2 | ExtensionSessionRenewer.java | 227 | [Retry:Login:com.vmw

Environment

VMware vCenter Server 7.x

VMware vCenter Server 8.x

Cause

This usually happens if  there is a mismatch between vpxd-extension certificate stored in VECS and the certificate information stored in vCenter Server Database for EAM extension

Resolution

To fix this we can perform below steps

• Take a snapshot of vCenter( Offline snapshot is required if vCenters are in linked mode)
• Review eam.log from this location: /var/log/vmware/eam/eam.log
• Execute lsdoctor script, command: Run “python lsdoctor.py -t” , Ref: https://knowledge.broadcom.com/external/article/320837/using-the-lsdoctor-tool.html
• If this doesn't fix errors then update the extension cert , Ref: https://knowledge.broadcom.com/external/article?articleNumber=318255
• If none of the above steps work reset the solution user certs , Ref: https://knowledge.broadcom.com/external/article?legacyId=2112283, Select Option 6