Upgrading Aria Operations (Formerly vRealize Operations) hangs at step 7 of 9 and does not complete.

Products

• VMware Aria Suite

Issue/Introduction

While upgrading the cluster, the upgrade process hangs for a long time and does not seem to proceed. The VMs are using minimal resources indicating that the upgrade has stalled.

Environment

Upgrading Aria Operations (formerly vRealize Operations) from 8.12 to 8.14

Cause

In the directory '/logs/pakManager/vRealizeOperationsManagerEnterprise-814022611353' you will find 'apply_os_update_stderr.log' where you can see the following error;

• DEBUG - stderr: "initramfs (re)generation triggerun 1 0 2.0-7.ph3
   (re)generate initramfs for all kernels, transfiletriggerpostun 2.0-7.ph3
   1. package zabbix-agent-4.4.10-1.1.ph3.x86_64 requires libcrypto.so.1.0.0()(64bit), but none of the providers can be installed
   Found 1 problem(s) while resolving
   Error(1301) : Solv general runtime error

Here was can see the 'zabbix-agent-4.4.10-1.1.ph3.x86_64' is the culprit but this could be any package not validated by Broadcom for use on Aria Operations.

This error cascades and causes the following error in the same log, which in turn causes the OS update process to exit unsuccessfully.

• Error in upgrading to Photon OS 4.0 from 3.0.
  		Original list of RPMs and RPM DB are stored in /tmp/photon-upgrade-6dD,  please provide contents of that folder along with system journal   logs for analysis; these logs can be captured using command-
  		# /usr/bin/journalctl -xa > /tmp/photon-upgrade-6dD/journal.log
  		Cannot continue. Aborting.

 

Resolution

Remove any additional packages from the appliance by running the following command, replacing the <package name> with the suspect package.

• rpm -e <package name>

Additional Information

Use the following command to generate a full list of packages installed on the appliance (Output file will be located in /tmp);

• tdnf list installed > "/tmp/tdnf_installed_$(hostname).txt"

Broadcom does not support the installation of 3rd party products on Aria Operations appliances as per this KB; 

• VMware Virtual Appliances and customizations to operating system and included packages