VMware Aria Automation 8.x upgrade hangs on the Upgrade status check state

Products

• VMware Aria Suite

Issue/Introduction

Symptoms:

• In Aria Suite Lifecycle Manager, Aria Automation upgrade is hanging in "upgrade status check" state.
• On Aria Automation appliance, the upgrade is not starting.
• The /var/log/vmware/prelude/upgrade-report-latest.json file on Aria Automation appliance is present, but empty.
• In /var/log/vrlcm/vmware_vrlcm.log you see an error similar to:

  YYYY-MM-DD TT:MM:SS.mss ERROR [pool-3-thread-24] c.v.v.l.p.c.v.t.VraVaUpgradeStatusCheckTask - – Failed to check upgrade status on vRealize Automation VA <VRA-FQDN>. Un-expected status in upgrade status check response. To know more about the failure, run command "vracli upgrade status --details" on the vRealize Automation VA <VRA-FQDN>. Optionally, the existing stale upgrade request can be cancelled and upgrade can be started afresh by clicking RETRY with cancelAndStartAfresh property set to true

Environment

VMware Aria Suite Lifecycle 8.x
VMware vRealize Automation 8.x

Cause

This issue occurs if either of below files have been manually truncated on Aria Automation appliance:

/var/log/vmware/prelude/upgrade-report-latest
/var/log/vmware/prelude/upgrade-report-latest.json

 

Resolution

Prerequisites

• You have API access and the necessary tools to create an API request to the system. Curl is made available out-of-the-box.

Note: For information on API usage and authentication, see VMware Aria Suite Lifecycle 8.12 API Programming Guide.

Procedure

To resolve this issue, cancel the upgrade and delete the offending files:

1. Take a snapshot of Aria Suite Lifecycle Manager.
2. Find the upgrade request ID (listed as vmid) using below API:

   GET https://LCM-hostFQDN/lcm/request/api/v2/requests

3. Cancel the request using below API:

   POST https://LCM-hostFQDN/lcm/request/api/requests/cancel/REQUEST_ID

4. In Aria Automation shell confirm the files are 0 bytes in size:

   ls -l /var/log/vmware/prelude/upgrade-report-latest*

5. Delete the empty upgrade report files:

   rm /var/log/vmware/prelude/upgrade-report-latest*

6. Restart the upgrade in VMware Aria Suite Lifecycle.