Aria Orchestrator scheduled workflows stop working after one week. vCenters listed as "Unusable" in Orchestrator.

Products

• VCF Operations/Automation (formerly VMware Aria Suite)

Issue/Introduction

Scheduled workflows in Orchestrator stop working after one week with the below errors seen in the logs (vco-server-app.log):

ERROR vco [host='vco-app-########-####' thread='tokenLifetimeMonitorScheduler-1' user='' org='' trace=''] {} com.vmware.o11n.security.session.ManagedTokenRegistryImpl - Unable to convert token with id ################################
com.vmware.vcac.authentication.http.SamlAuthenticationException: Token expiration date: <DATE> is in the past.

ERROR vco [host='vco-app-########-####' thread='tokenLifetimeMonitorScheduler-1' user='' org='' trace=''] {} com.vmware.vim.sso.client.impl.SoapBindingImpl - SOAP fault
com.sun.xml.ws.fault.ServerSOAPFaultException: Client received SOAP Fault from server: Unable to renew non-renewable token Please see the server log to find more detail regarding exact cause of the failure.

vCenters may be listed as "unusable" in Orchestrator -> Administration -> Inventory -> vCenter plugin.

Environment

Aria Automation/Orchestrator 8.18.1

Cause

Aria Orchestrator fails to renew it's access token to vCenter.

Resolution

A fix for this issue is tentatively planned for 8.18.1 Patch 4.

Alternatively, the below steps can be followed to resolve the issue without Patch 4.

1. Install Orchestrator 8.18.1 Patch 3.
2. Add custom property "com.vmware.o11n.sso.svcaccount.ephemeral-cert-lifetime-ms" to the affected Orchestrator, as per KB 408782. 
3. Then remove the current schedule for the affected workflow and re-schedule it.

Scheduled workflows will then continue running after one week.