Upgrading Aria Operations (Formerly vRealize Operations) hangs at step 7 of 9 and does not complete.
Article ID: 373057
Updated On:
Products
Issue/Introduction
While upgrading the cluster, the upgrade process hangs for a long time and does not seem to proceed.
The VMs are using minimal resources indicating that the upgrade has stalled.
Environment
Aria Operations 8.12.x and later
Cause
- The file
/logs/pakManager/vRealizeOperationsManagerEnterprise-814022611353/apply_os_update_stderr.log contains the following error. - Here the 'zabbix-agent-4.4.10-1.1.ph3.x86_64' is the culprit, but this could be any package not validated by Broadcom for use on Aria Operations.
DEBUG - stderr: "initramfs (re)generation triggerun 1 0 2.0-7.ph3 (re)generate initramfs for all kernels, transfiletriggerpostun 2.0-7.ph3 1. package zabbix-agent-4.4.10-1.1.ph3.x86_64 requires libcrypto.so.1.0.0()(64bit), but none of the providers can be installed Found 1 problem(s) while resolving Error(1301) : Solv general runtime error
-
The file
/logs/pakManager/vRealizeOperationsManagerEnterprise-818xxxxxxxxxxx/apply_os_update_stderr.logmay contains the following error.
ERROR - Failed to upgrade to Photon5: 2025-02-14T11:39:20+1030 Upgrading Photon OS from 4.0 to 5.0. Assuming that data backup has already been done.2025-02-14T11:39:20+10302025-02-14T11:39:21+1030 Recording list of all installed RPMs on this machine to /tmp/photon-upgrade.sh-2025-02-14-11-39-20/rpm-qa.txt.2025-02-14T11:39:21+1030 Creating backup of RPM DB.2025-02-14T11:39:21+1030 Generating tdnf cache on Photon OS 4.0Refreshing metadata for: 'VMWare Photon Pak ISO 5.0(x86_64)'Metadata cache created.2025-02-14T11:39:21+1030 The following deprecated packages will be removed before upgrade - python3-backports_abc2025-02-14T11:39:21+1030 Generating tdnf cache on Photon OS 5.0Refreshing metadata for: 'VMWare Photon Pak ISO 5.0(x86_64)'Metadata cache created.2025-02-14T11:39:21+1030 Finding packages in the target repo. This may take several minutes., /usr/bin/cp: missing destination file operand after '/tmp/photon-upgrade.sh-2025-02-14-11-39-20'Try '/usr/bin/cp --help' for more information.2025-02-14T11:39:22+1030 Error: Packages - tcpdump - are not available in the target repo for OS upgrade. Please provide the correct repo having the required packages.Original list of RPMs and RPM DB are stored in /tmp/photon-upgrade.sh-2025-02-14-11-39-20, please provide contents of that folder along with system journal logs for analysis; these logs can be captured using command- # /usr/bin/journalctl -xa > /tmp/photon-upgrade.sh-2025-02-14-11-39-20/journal.log Cannot continue. Aborting.
- Above logs indicate that the upgrade failed due to the TCPDUMP package.
- This error cascades and causes the following error in the same log, which in turn causes the OS update process to exit unsuccessfully.
Error in upgrading to Photon OS 4.0 from 3.0. Original list of RPMs and RPM DB are stored in /tmp/photon-upgrade-6dD, please provide contents of that folder along with system journal logs for analysis; these logs can be captured using command- # /usr/bin/journalctl -xa > /tmp/photon-upgrade-6dD/journal.log Cannot continue. Aborting.
Resolution
To resolve the issue, follow these steps to remove any additional packages from the appliance:
- Run the following command to find the full name of the RPM:
rpm -qa | grep -i <package_name>
-
Remove the unvalidated package
- Replace <package_name> with the suspect package and run:
rpm -e <package_name>
- Replace <package_name> with the suspect package and run:
-
Restart the upgrade
- Once the package is removed, proceed with restarting the upgrade process.
Additional Information
Use the following command to generate a full list of packages installed on the appliance (Output file will be located in /tmp)
-
tdnf list installed > "/tmp/tdnf_installed_$(hostname).txt"
Broadcom does not support the installation of 3rd party products on Aria Operations appliances as per below KB
Feedback
