SDDC Manager UI loads with error : Server failed to start. Check the SDDC Manager UI Server logs for more details.

Products

• VMware SDDC Manager

Issue/Introduction

SDDC Manager UI loads with error : Server failed to start. Check the SDDC Manager UI Server logs for more details.

/var/log/vmware/vcf/sddc-manager-ui-app

sddcManagerServer.log

YYYY-MM-DDT04:44:39.921+0000 VERBOSE [ab51f8d87611421f] [servers/errorStateServer/index.js, error-server-init, null:44] Incoming request for error server {"url":"/ui/sddc-manager/inventory/domains/mgmt-vi-domains(monitoring-panel:monitoring/tasks)"}
YYYY-MM-DDT04:44:40.001+0000 VERBOSE [ab51f8d87611421f] [servers/errorStateServer/index.js, error-server-init, null:44] Incoming request for error server {"url":"/ui/error"}
YYYY-MM-DDT04:44:40.002+0000 ERROR [ab51f8d87611421f] [services/errorHandling.js, error-server-init, errorStateHandler:47] Server is in error state; serving up error html {"serverErrorState":{"code":null,"state":"error"}}
YYYY-MM-DDT04:44:40.004+0000 VERBOSE [ab51f8d87611421f] [servers/errorStateServer/index.js, error-server-init, null:44] Incoming request for error server {"url":"/ui/"}
YYYY-MM-DDT04:44:41.906+0000 VERBOSE [ab51f8d87611421f] [servers/errorStateServer/index.js, error-server-init, null:44] Incoming request for error server {"url":"/ui/sddc-manager/inventory/domains/mgmt-vi-domains(monitoring-panel:monitoring/tasks)"}
YYYY-MM-DDT04:44:41.936+0000 VERBOSE [ab51f8d87611421f] [servers/errorStateServer/index.js, error-server-init, null:44] Incoming request for error server {"url":"/ui/error"}
YYYY-MM-DDT04:44:41.937+0000 ERROR [ab51f8d87611421f] [services/errorHandling.js, error-server-init, errorStateHandler:47] Server is in error state; serving up error html {"serverErrorState":{"code":null,"state":"error"}}
YYYY-MM-DDT04:44:41.939+0000 VERBOSE [ab51f8d87611421f] [servers/errorStateServer/index.js, error-server-init, null:44] Incoming request for error server {"url":"/ui/"}

YYYY-MM-DDT04:46:25.000+0000 ERROR [5a0a439e47054770] [services/ws1bAuthentication/ws1bAuthenticationService.js, init, getWs1bClientId:95] error during getWs1bClientId Request failed with status code 500 {"body":{"arguments":["Identity Internal Server Error"],"causes":[{"message":"Failed to get the IDP type due to Identity Internal Server Error.","type":"com.vmware.evo.sddc.common.core.error.FederatedBrokerIdentityException"},{"message":"Identity Internal Server Error","type":"com.vmware.evo.sddc.identity.model.error.PscException"},{"message":"Unable to obtain Security Token Service from SSO 'vcsa01.gslabs.local'","type":"com.vmware.evo.sddc.common.services.psc.exception.PscException"},{"message":"Server returned 'request expired' less than 0 seconds after request was issued, but it shouldn't have expired for at least 600 seconds.","type":"com.vmware.vim.sso.client.exception.TimeSynchronizationException"}],"errorCode":"SDDCMANAGER_GET_OIDC_INFO_FAILED","referenceToken":"UDKQTS"},"code":"SDDCMANAGER_GET_OIDC_INFO_FAILED","stack":{"code":"ERR_BAD_RESPONSE","config":{"adapter":["xhr","http"],"env":{},"headers":{"Accept":"application/json, text/plain, */*","Accept-Encoding":"gzip, compress, deflate, br","Content-Type":"application/json","User-Agent":"axios/1.6.2","X-B3-SpanId":"5a0a439e47054770","X-B3-TraceId":"5a0a439e47054770"},"maxBodyLength":-1,"maxContentLength":-1,"method":"get","timeout":0,"transformRequest":[null],"transformResponse":[null],"transitional":{"clarifyTimeoutError":false,"forcedJSONParsing":true,"silentJSONParsing":true},"url":"http://127.0.0.1/v1/identity-broker/sddc-manager-oidc","xsrfCookieName":"XSRF-TOKEN","xsrfHeaderName":"X-XSRF-TOKEN"},"message":"Request failed with status code 500","name":"AxiosError","status":500},"statusCode":500}
^C

/var/log/vmware/vcf/commonsvcs

vcf-commonsvcs.log

YYYY-MM-DDT04:48:27.939+0000 INFO  [common,b8be5fd80bdb4a65,b28c] [c.v.e.s.i.s.PscInventoryServiceEmbeddedImpl,http-nio-127.0.0.1-7100-exec-5] Returned PSCs: [Psc(domainId=727ed6bb-ee7c-4987-8d5c-778dd5d7000c, vmName=vcsa01, vmManagementIpAddress=192.168.1.10, vmHostname=vcsa01.gslabs.local, isReplica=false, port=443, ssoDomain=vsphere.local, subDomain=gslabs.lo
cal, sshHostKeyType=null, sshHostKey=null, bundleRepoDatastore=lcm-bundle-repo, datastoreName=VCF-GS-Cloud-vSAN01, status=ACTIVE, version=8.0.3.00000-24022515, deploymentType=EMBEDDED)]
YYYY-MM-DDT04:48:27.939+0000 INFO  [common,b8be5fd80bdb4a65,b28c] [c.v.e.s.i.s.services.PscServiceImpl,http-nio-127.0.0.1-7100-exec-5] Creating admin client using psc host vcsa01.gslabs.local
YYYY-MM-DDT04:48:27.969+0000 WARN  [common,b8be5fd80bdb4a65,b28c] [c.v.v.s.a.c.v.impl.AbstractClient,http-nio-127.0.0.1-7100-exec-5] ******* WARNING ****** WARNING ****** WARNING *******
YYYY-MM-DDT04:48:27.969+0000 WARN  [common,b8be5fd80bdb4a65,b28c] [c.v.v.s.a.c.v.impl.AbstractClient,http-nio-127.0.0.1-7100-exec-5] Possible remote API mismatch detected. Operation will continue, but errors are likely.
YYYY-MM-DDT04:48:27.969+0000 WARN  [common,b8be5fd80bdb4a65,b28c] [c.v.v.s.a.c.v.impl.AbstractClient,http-nio-127.0.0.1-7100-exec-5] ******* WARNING ****** WARNING ****** WARNING *******
YYYY-MM-DDT04:48:27.969+0000 INFO  [common,b8be5fd80bdb4a65,b28c] [c.v.v.s.a.c.v.impl.AdminClientImpl,http-nio-127.0.0.1-7100-exec-5] Client was created successfully
YYYY-MM-DDT04:48:27.984+0000 INFO  [common,b8be5fd80bdb4a65,b28c] [c.v.v.s.a.c.v.impl.AbstractClient,http-nio-127.0.0.1-7100-exec-5] Client was disposed successfully
YYYY-MM-DDT04:48:27.985+0000 INFO  [common,6894301b87f581de78dac4393d4fa628,3c0d] [c.v.e.s.a.u.a.r.CertificateController,http-nio-127.0.0.1-7100-exec-3] Inside getCertificateConfiguration
YYYY-MM-DDT04:48:28.101+0000 ERROR [common,b8be5fd80bdb4a65,b28c] [c.v.v.s.client.impl.SoapBindingImpl,http-nio-127.0.0.1-7100-exec-5] SOAP fault
com.sun.xml.ws.fault.ServerSOAPFaultException: Client received SOAP Fault from server: The time now Thu Aug 07 04:34:55 GMT 2025 does not fall in the request lifetime interval extended with clock tolerance of 600000 ms: [ Thu Aug 07 04:38:28 GMT 2025; Thu Aug 07 05:08:28 GMT 2025). This might be due to a clock skew problem. Please see the server log to find more
 detail regarding exact cause of the failure.
        at com.sun.xml.ws.fault.SOAP11Fault.getProtocolException(SOAP11Fault.java:163)
YYYY-MM-DDT04:48:28.102+0000 INFO  [common,b8be5fd80bdb4a65,b28c] [c.v.v.s.c.i.SecurityTokenServiceImpl$RequestResponseProcessor,http-nio-127.0.0.1-7100-exec-5] Request message has expired. Server message: ns0:MessageExpired: The time now Thu Aug 07 04:34:55 GMT 2025 does not fall in the request lifetime interval extended with clock tolerance of 600000 ms: [ Thu Aug 07 04:38:28 GMT 2025; Thu Aug 07 05:08:28 GMT 2025). This might be due to a clock skew problem.
YYYY-MM-DDT04:48:28.102+0000 INFO  [common,b8be5fd80bdb4a65,b28c] [c.v.v.s.c.i.SecurityTokenServiceImpl$RequestResponseProcessor,http-nio-127.0.0.1-7100-exec-5] Server returned 'request expired' less than 0 seconds after request was issued, but it shouldn't have expired for at least 600 seconds.
YYYY-MM-DDT04:48:28.102+0000 ERROR [common,b8be5fd80bdb4a65,b28c] [c.v.e.s.i.s.services.PscServiceImpl,http-nio-127.0.0.1-7100-exec-5] Error while creating admin client using psc vcsa01.gslabs.local
YYYY-MM-DDT04:48:28.102+0000 ERROR [common,b8be5fd80bdb4a65,b28c] [c.v.e.s.i.s.services.PscServiceImpl,http-nio-127.0.0.1-7100-exec-5] No psc host avialable.
YYYY-MM-DDT04:48:28.102+0000 ERROR [common,b8be5fd80bdb4a65,b28c] [c.v.e.s.i.s.IdentityProviderServiceImpl,http-nio-127.0.0.1-7100-exec-5] Failed to get the IDP type Identity Internal Server Error
YYYY-MM-DDT04:48:28.102+0000 ERROR [common,b8be5fd80bdb4a65,b28c] [c.v.e.s.i.r.a.c.v.IdentityProviderController,http-nio-127.0.0.1-7100-exec-5] Unable to get sddc manager oidc information due to Identity Internal Server Error
YYYY-MM-DDT04:48:28.103+0000 ERROR [common,b8be5fd80bdb4a65,b28c] [c.v.e.s.e.h.LocalizableRuntimeExceptionHandler,http-nio-127.0.0.1-7100-exec-5] [7I01S6] SDDCMANAGER_GET_OIDC_INFO_FAILED
com.vmware.evo.sddc.identity.rest.api.error.IdentityRestServiceException:
        at com.vmware.evo.sddc.identity.rest.api.controller.v1.IdentityProviderController.getSddcWs1bOidcInfo(IdentityProviderController.java:444)
YYYY-MM-DDT04:48:32.404+0000 ERROR [common,68943020beeeed51b95c0dae9193953e,2ec3] [c.v.e.s.i.s.VcfServiceInventoryServiceImpl,http-nio-127.0.0.1-7100-exec-6] Error while trying to retrieve service http://127.0.0.1/sddc-manager-ui-app/about status, 500 Internal Server Error: "<html><EOL>  <head><EOL>    <title>Server failed to start !</title><EOL>    <style type=

Environment

VMware Cloud Foundation 5.x

Cause

A time synchronization (time skew) issue between the vCenter Server and the SDDC Manager node.

Resolution

• Verify Time Sync :

Check if either the vCenter Server or the SDDC Manager node is out of sync. If the SDDC Manager time is incorrect and the UI is not accessible to verify or update NTP settings, proceed with the steps below.

• Manually Set Time on SDDC Manager :

Align the SDDC Manager time with vCenter using the following command (replace <date-time> with the correct UTC timestamp based on your vCenter):

date --set="<YYYY-MM-DD HH:MM:SS UTC>"

Example: date --set="YYYY-MM-DD 04:30:00 UTC"

• Restart SDDC Manager Services

Once the time is corrected, restart the SDDC Manager services using: /opt/vmware/vcf/operationsmanager/scripts/cli/sddcmanager_restart_services.sh

• Validate and Update NTP Settings :

After the UI becomes accessible, log in and review the NTP configuration

• Ensure the SDDC Manager is configured with the correct NTP servers to prevent future time drift.