Upgrading VMware Identity Manager fails with Exception "Error Code: LCMUPGRADEVIDM71212 Unable to perform reboot on the vIDM instance"

Products

• VCF Operations/Automation (formerly VMware Aria Suite)

Issue/Introduction

• Upgrade request for VMware Identity Manager from VMware Aria Lifecycle Manager fails with below error: 

Error Code: LCMUPGRADEVIDM71212 

Unable to perform reboot on the vIDM instance.Refer to log for additional details and retry.

Exception occurred while performing VMware Identity Manager upgrade. Exception message: Cannot execute SSH commands. Verify the SSH login credentials.

•  A similar error will be visible in the /var/log/vrlcm/vmware_vrlcm.log of Aria Lifecycle Manager:

com.vmware.vrealize.lcm.util.exception.SshAuthenticationFailureException: Cannot execute SSH commands. Verify the SSH login credentials.
    at com.vmware.vrealize.lcm.util.SshUtils.execute(SshUtils.java:720)
    at com.vmware.vrealize.lcm.util.SshUtils.execute(SshUtils.java:647)
    at com.vmware.vrealize.lcm.vidm.driver.helpers.VidmUtil.runVidmSshCommand(VidmUtil.java:162)
    at com.vmware.vrealize.lcm.vidm.core.task.VidmRebootTask.execute(VidmRebootTask.java:118)
    at com.vmware.vrealize.lcm.platform.automata.service.Task.retry(Task.java:158)
    at com.vmware.vrealize.lcm.automata.core.TaskThread.run(TaskThread.java:60)
    at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
    at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
    at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.lang.RuntimeException: Cannot create session for ssh://root@<VIDM-NODE FDQN/IP-ADDRESS>
    at com.vmware.vrealize.lcm.util.SessionHolder.newSession(SessionHolder.java:57)
    at com.vmware.vrealize.lcm.util.SessionHolder.<init>(SessionHolder.java:37)
    at com.vmware.vrealize.lcm.util.SshUtils.execute(SshUtils.java:666)

• vIDM appliance /root file system is full.

  • Partition / 100%
    
    • Dev/sda4 or Dev/sda2 / 100%

Environment

• VMware Aria Suite Lifecycle 8.x
• VMware Identity Manager 3.3.x

Cause

The upgrade process is interrupted when the root partition on the VIDM nodes becomes full.

Resolution

Reduce the root partition usage on the VMware Identity Manager nodes by adhering to the steps outlined in vIDM root partition is full on one node of the cluster