vRASSC upgrade from version 8.3 to 8.4 triggered from vRSLCM, is stuck in progress and timed out after 15 min

Products

• VMware Aria Suite

Issue/Introduction

Symptoms:

• vRSLCM triggers upgrade requests by executing upgrade commands on vRASSC.
• The VAMI upgrade completes successfully but the request is stuck in progress for RAAS upgrade.
• The upgrade process in vRASSC is not completed and is stuck with a few child processes in active state.
• vRSLCM times out the upgrade request after 15 minutes.

Environment

VMware vRealize Suite Lifecycle Manager 8.x
VMware Aria Automation Config 8.12.x

Resolution

This is a known issue affecting VMware vRealize Suite Lifecycle Manager version 8.4.
Currently, there is no resolution.

Workaround:
To work around this issue:

1. SSH to VSSC appliance and execute the ps faux command on vRASSC.
2. Check if the upgrade process and its child processes are still running.

Sample process tree:

root 1998 0.0 0.0 11992 6700 ? Ss 09:39 0:00 sshd: root@notty
root 2000 0.0 0.0 8184 4264 ? Ss 09:39 0:00 \_ bash -c sh /var/lib/vssc/raas-upgrade /var/lib/vssc %s |& tee -a/var/log/lcm-raas-upgrade.log
root 2020 0.0 0.0 4124 2912 ? S 09:39 0:00 \_ sh /var/lib/vssc/raas-upgrade /var/lib/vssc %s
   root 2178 0.0 0.0 7088 3312 ? S 09:39 0:00 | \_ sudo su raas
   root 2179 0.0 0.0 4268 2580 ? S 09:39 0:00 | \_ su raas
   raas 2180 0.0 0.0 4124 2952 ? S 09:39 0:00 | \_ bash
   raas 2182 62.0 0.0 12600 9508 ? S 09:39 0:03 | \_ raas upgrade
   raas 2185 93.5 0.6 296548 101576 ? Rl 09:39 0:01 | \_ raas upgrade
   root 2021 0.0 0.0 2260 688 ? S 09:39 0:00 \_ tee -a /var/log/lcm-raas-upgrade.log

3. Terminate the process and all its child processes.

Example: kill -9 2000 2020 2178 2179 2180 2182 2185 3

4. Check if the RAAS service is up and running:

# systemctl status raas

If the service is not available, start the service using the commands:

# systemctl enable raas
# systemctl start raas

5. If the vRASSC instance:
   1. Already upgraded to 8.4:
      1. Check if vRASSC UI is available and check "Version Info" to confirm if vRASSC is upgraded to 8.4:
      2. Trigger inventory sync in vRSLCM for vRA environment associated with the vRASSC instance to update the versions and other details for vRASSC.
   2. Upgrade not succeeded on vRASSC:

 Check if vRASSC UI is available and "Version Info" to confirm if vRASSC is still in version 8.3. The below steps also applies in case the UI is not accessible and vRASSC is at inconsistent state post upgrade process.

1. Revert to the pre-upgrade snapshot.
2. Re-trigger upgrade request from vRSLCM.