Caused by: com.vmware.vim.sso.client.exception.InternalError: Failed trying to retrieve token: ns0:RequestFailed: EndTime: ### ### ## ##:##:## is not after startTime: ### ### ## ##:##:##
at com.vmware.vim.sso.client.impl.SecurityTokenServiceImpl$RequestResponseProcessor.handleFaultCondition(SecurityTokenServiceImpl.java:1161)The authentication mechanism in Orchestrator 8.18.1 has been updated to employ service accounts. This change ensures compatibility with VCF 9, where solution users will no longer be supported.
VMware Engineering has identified the cause and is developing a resolution for an upcoming release. To receive an automated notification once the fix is deployed, subscribe to this article
As a workaround the Orchestrator authentication can be changed back to use a solution user to do so follow this article:
vco.vsphere.lookup-service.ssl.certificate validate with command:vracli vro authenticationvracli vro authentication unregister -u '<VC_USERNAME>'base64 -d <<< "a3ViZWN0bCBleGVjIC1uIHByZWx1ZGUgIiQodnJhY2xpIHN0YXR1cyB8IGpxIC1yICcuZGF0YWJhc2VOb2Rlc1tdIHwgc2VsZWN0KC5Sb2xlPT0icHJpbWFyeSIpLiJOb2RlIG5hbWUiJyB8IGN1dCAtZCAnLicgLWYgMSkiIC0tIGNocHN0IC11IHBvc3RncmVzIHBzcWwgXAogICAgLWQgInZjby1kYiIgXAogICAgLWMgIgogICAgICBERUxFVEUgRlJPTSB2bW9fY29uZmlnaXRlbQogICAgICBXSEVSRSBuYW1lPSdjb20udm13YXJlLm8xMW4uZm9yY2UtZGF0YWJhc2UtY29uZmlndXJhdGlvbic7CiAgICAgICIgJiYgXAp2cmFjbGkgY2x1c3RlciBleGVjIC0tIHNlZCAtaSAnL2NvbS52bXdhcmUubzExbi5mb3JjZS1kYXRhYmFzZS1jb25maWd1cmF0aW9uL2QnIC9kYXRhL3Zjby91c3IvbGliL3Zjby9hcHAtc2VydmVyL2NvbmYvdm1vLnByb3BlcnRpZXM=" | bash -kubectl exec -itn prelude $(kubectl get pod -n prelude -l app=vco-app -o jsonpath="{.items[0].metadata.name}") -c vco-server-app -- bashrpm -i --nodeps vco-cfg-cli.rpm && cp /usr/lib/vco/app-server/deploy/vco/WEB-INF/lib/* /usr/lib/vco-cli/lib/usr/lib/vco-cli/bin/vro-configure-inner.sh authentication-vsphere --register --lsUrl https://<VC_URL> --username '<VC_USERNAME>' --password '<VC_PASSWORD>' --adminGroup '<VC_ADMIN_GROUP>' --adminGroupDomain '<VC_ADMIN_GROUP_DOMAIN>' --tenant '<VC_TENANT>'kill 1kubectl -n prelude get pods -w
In situations where the workaround is not working:
/data/vco/usr/lib/vco/app-server/conf/vmo.properties still has the property com.vmware.o11n.force-database-configuration if so remove it manually from each node: vracli cluster exec -- sed -i '/com.vmware.o11n.force-database-configuration/d' /data/vco/usr/lib/vco/app-server/conf/vmo.propertiesbackToLoginLabel error:kubectl exec -itn prelude $(kubectl get pod -n prelude -l app=vco-app -o jsonpath="{.items[0].metadata.name}") -c vco-server-app -- bashrpm -i --nodeps vco-cfg-cli.rpm && cp /usr/lib/vco/app-server/deploy/vco/WEB-INF/lib/* /usr/lib/vco-cli/lib/usr/lib/vco-cli/bin/vro-configure-inner.sh authentication-vsphere --unregister --username '<VC_USERNAME>' --password '<VC_PASSWORD>'Notes: The stack/timestamp seen is generic caused by a dummy certificate injected in the code and cannot be replaced