Upgrade successful on Primary node but fails on Worker Node
search cancel

Upgrade successful on Primary node but fails on Worker Node

book

Article ID: 419229

calendar_today

Updated On:

Products

VCF Operations/Automation (formerly VMware Aria Suite)

Issue/Introduction

When a cluster gets upgraded from 8.16 to 8.18. The primary node upgrades successfully, but the remaining nodes fail to upgrade. When attempting to upgrade the second node (which is in maintenance mode), the upgrade immediately reports “failed.”

Environment

Aria Operations for Logs 8.x

Cause

If the upgrade on a primary node or middle worker node is interrupted, the upgrade for the rest of the cluster will hang, and will need to be continued manually via the command line.

Resolution

To upgrade VMware Aria Operations for Logs to the preferred version via the command line, please complete the following steps.

Note: If you are upgrading the cluster from scratch, start with the Primary node and then the subsequent worker nodes.

  1. Download the VMware Aria Operations for Logs upgrade PAK file from Broadcom Downloads.
  2. Copy the upgrade PAK file to the /tmp directory on the target node using an SCP utility.
  3. Log into the target node as root via SSH or Console.
  4. Run the following command to upgrade the node:
/usr/lib/loginsight/application/sbin/loginsight-pak-upgrade.py /tmp/pak_file

Note: Replace pak_file with the actual name of the file you downloaded.

Example: /usr/lib/loginsight/application/sbin/loginsight-pak-upgrade.py /tmp/VMware-vRealize-Log-Insight-8.12.0-21618456.pak
  1. Wait for the upgrade to complete.
  2. Repeat steps 1-5 on any other nodes in the cluster that need to be upgraded via the command line.


See the Related Information section for steps to re-apply the certificate to ensure the internode communication certificate gets updated.

Additional Information

After completing the manual upgrade steps in the Resolution section, ensure the cluster gets the updated internode communication certificate by re-applying the certificate.
Follow Install a custom certificate if you are using a custom certificate for VMware Aria Operations for Logs.
If you are using the default certificate, follow Revert to the default certificate.

Install a custom certificate

  1. Log into the VMware Aria Operations for Logs as the local admin user.
  2. Navigate to Configuration > SSL.
  3. Click Choose File and select the certificate file you wish to use.
Note: VMware Aria Operations 8.12 and later requires Client Auth usage.  Ensure your custom certificate meets this requirement.
  1. Click Save.


Revert to the default certificate

  1. Log into the VMware Aria Operations for Logs UI as the local admin user.
  2. Navigate to Configuration > SSL.
  3. Click RESET TO DEFAULTS....
  1. Click Reset.



Impact/Risks:
Starting with VMware Aria Operations for Logs 8.12, the upgrade process updates the internode communication certificate.  However, the certificate update only happens if the rolling upgrade is successful and won’t be triggered in case of a manual upgrade.  To ensure the cluster gets the updated internode communication certificate, see the Related Information section for instructions on re-applying the certificate after completing the Resolution steps in this article.

Powered by Wolken Software