vCenter 8.0 U3d /Upgrade vc-ws1a-broker Service Fails to Start (Operation Timed Out)

Products

• VMware vCenter Server 8.0

Issue/Introduction

• After upgrading vCenter Server to version 8.0 U3d the vc-ws1a-broker service fails to start during post-upgrade with the error:

“Service-control failed. Error: Failed to start services in profile ALL. RC=1, stderr=Failed to start vc-ws1a-broker services. Error: Operation timed out.”

• While starting the service manually we found below traces in /var/log/vmware/vc-ws1a-broker/federation-service.log

YYYY-MM-DDTHH:MM:SS,XXX ERROR XXXXXXX.XXXXXX-XXX.XXX-XXX. XXXXXXXXX. com. XX: federation (ForkJoinPool-2-worker-2) [ -;-;-;-;-;- ] com. vmware. vidm. federation.AcsMetadataRegistrar

Failed to register metadata with ACS: {"errors": [{"code":"401", "message": "Unauthorized"} ] }, will retry again in 1 seconds ScUnauthorizedException [Operation: POST -> http://localhost:10114/acs/services] [Status: 401]
at com. vmware. vidm. common.http. client.exception. HttpServerExceptionFactory. aHttpServerException (HttpServerExceptionFactory. java:59)
at com. vmware. vidm. common. http.client.exception. HttpServerExceptionFactory. aHttpServerException (HttpServerExceptionFactory. java:26)
at com. vmware. vidm. common. http. client. Request. verify (Request. java: 651)
at java.base/java. util. concurrent. CompletableFuture$UniApply. tryFire (Unknown Source)
at java.base/java.util.concurrent.CompletableFuture.postComplete (Unknown Source)
at java.base/java. util. concurrent. CompletableFuture.postFire (Unknown Source)
at java.base/java. util. concurrent. CompletableFuture$UniCompose.tryFire (Unknown Source)
at java.base/java.util.concurrent.CompletableFuture$Completion.run (Unknown Source)
at com. vmware. vidm. common. async. ContextPassingExecutor. lambda$wrap$0 (ContextPassingExecutor. java: 48)
at java.base/java. util. concurrent. ForkJoinTask$RunnableExecuteAction.exec (Unknown Source)
at java.base/java.util.concurrent.ForkJoinTask.doExec (Unknown Source)
at java. base/java. util. concurrent. ForkJoinPool$WorkQueue. topLevelExec (Unknown Source)
at java.base/java.util. concurrent. ForkJoinPool.scan (Unknown Source)
at java.base/java.util.concurrent.ForkJoinPool.runWorker (Unknown Source)
at java. base/java. util. concurrent. ForkJoinWorkerThread. run (Unknown Source)

 

Cause

The failure is due to an incomplete patch or upgrade, where the vc-ws1a-broker service is unable to register metadata with its ACS (Access Control Service) endpoint. 

 

Resolution

This requires validation, please consult Broadcom Support for further assistance.