Error:"Your subscription has expired" after upgrade to Aria Automation/Aria Orchestrator 8.18.x

Products

• VCF Operations/Automation (formerly VMware Aria Suite)

Issue/Introduction

Following the upgrade to Aria Automation or Aria Orchestrator version 8.18.x, users may experience intermittent below error when executing workflows or actions within Aria Orchestrator.

Error: "Your subscription has expired. The core product operations are unavailable. Please contact your Account Manager or Customer Success Manager to renew your license".

Below events can be seen in vco-server-app.log 

2024-07-22T04:03:42.697Z WARN vco [host='vco-app-##########-#####' thread='licenseComplianceScheduler-1' user='' org='' trace=''] {} com.vmware.o11n.service.license.retriever.LicenseComplianceRetriever - Error occurred during license compliance retrieval.
com.vmware.o11n.service.license.RetrieveLicenseException: Request to automation license endpoint failed.

2024-07-22T04:03:42.701Z WARN vco [host='vco-app-##########-#####' thread='licenseComplianceScheduler-1' user='' org='' trace=''] {} com.vmware.o11n.service.license.task.LicenseComplianceTask - License compliance state is restricted. 

2024-07-22T04:08:53.369Z ERROR vco [host='vco-app-##########-#####' thread='http-nio-8280-exec-118' user='' org='' trace='-'] {} com.vmware.o11n.web.common.BaseController - Error invoking REST [unknown]
ch.dunes.util.DunesServerException: ch.dunes.util.OperationNotEntitledException: Requested operation is not permitted due to no valid license entitlement

Environment

VMware Aria Orchestrator 8.18.x

VMware Aria Automation 8.18.x

Cause

The observed failures happen intermittently. 

Some calls to the orchestrator are failing with errors after the license entitlement restriction checks is reported as restricted. The license check in turn has failed due to usage of an expired token used for authentication. After several minutes the expired token is refreshed and the license restriction is lifted resulting in continuing normal operation.

Resolution

Run the below command on any one node within the cluster to apply the 'license check system property' and wait for the vco pods to restart.

# vracli vro properties set --key com.vmware.o11n.license.check.automation-endpoint.enabled --value false

For the embedded Orchestrator the above command needs to run on the Aria Automation Node.

Additional Information

This issue can be referred in known issue section of 8.18 release notes.

VMware Aria Automation Release Notes