SDDC manager contains errors similar to the excerpt below:
Log Location: /var/log/vmware/vcf/sddc-manager-ui-app/sddcManagerServer.log[YYYY-MM-DDTHH:MM:SS] ERROR [6f0300f252524152] [services/authorization.js, http-post-callback, isAuthorizedUser:68]500.144: VError: User Authorization failed: 500 - "{\"errorCode\":\"IDENTITY_INTERNAL_SERVER_ERROR\",\"arguments\":[],\"message\":\"Identity Internal Server Error\",\"referenceToken\":\"#####\"}" at Object.authorizationFailedError (/opt/vmware/vcf/sddc-manager-ui-app/server/src/errors/VCFError.js:100:5) at isAuthorizedUser (/opt/vmware/vcf/sddc-manager-ui-app/server/src/services/authorization.js:67:41) at runMicrotasks (<anonymous>) at processTicksAndRejections (node:internal/process/task_queues:96:5) at async authorizeUser (/opt/vmware/vcf/sddc-manager-ui-app/server/src/services/authorization.js:30:9)Error Info: {"errorModule":500,"errorCode":144}caused by:StatusCodeError: 500 - "{\"errorCode\":\"IDENTITY_INTERNAL_SERVER_ERROR\",\"arguments\":[],\"message\":\"Identity Internal Server Error\",\"referenceToken\":\"######\"}"
Log Location: /var/log/vmware/vcf/commonsvcs/vcf-commonsvcs.log[YYYY-MM-DDTHH:MM:SS] ERROR [common,6f0300f252524152,7cf1] [c.v.e.s.e.h.LocalizableRuntimeExceptionHandler,http-nio-###.#.#.#-7100-exec-9880] [L1H58B] IDENTITY_INTERNAL_SERVER_ERROR Identity Internal Server Errorcom.vmware.evo.sddc.identity.rest.api.error.PermissionException: Identity Internal Server Error at com.vmware.evo.sddc.identity.rest.api.controller.PermissionController.doAuthorization(PermissionController.java:89) at jdk.internal.reflect.GeneratedMethodAccessor736.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.base/java.lang.reflect.Method.invoke(Method.java:566)
VMware SDDC Manager 4.5.x
In version 4.5.x, there have been occurrences of this problem due to excessive thread overhead leading to a deadlock, which results in a timeout in the SDDC GUI and display of this error.
This problem can occur at approximately 60-day intervals.
The issue has been fixed in VCF version 5.x and later.
Currently, there is no resolution for version 4.5.x
Workaround: Restart the 'commonsvcs' service using the following command -
1. Login to the SDDC manager through SSH using user vcf
2. Switch to root - su root
3. Restart the service -
systemctl restart commonsvcs
If the service restart doesn't fix the issue - Reboot the SDDC Manager appliance.