Upgrading Aria Operations via Aria Lifecycle fails with error code: LCMVROPSYSTEM25029

Products

• VCF Operations/Automation (formerly VMware Aria Suite)

Issue/Introduction

When upgrading Aria Operations via Aria Suite Lifecycle, similar errors and details shown below are presented in LCM:

Error Code: LCMVROPSYSTEM25029

VMware Aria Operations upgrade failure:

Error Code: LCMVROPSYSTEM25029  VMware Aria Operations patch install failed  [{"rel":"pak_cluster_status","href":"https://vrops_IP_or_FQDN/casa/upgrade/cluster/pak/vRealizeOperationsManagerEnterprise-818324663027/status"},  {"rel":"pak_current_activity","href":"https://vrops_IP_or_FQDN/casa/upgrade/cluster/pak/reserved/current_activity"}]

The vrops-status command indicates that the vpostgres service is not running, with the following message:

pg_ctl: invalid date in PID file "/storage/db/vcops/vpostgres/data/postmaster.pid"

Environment

Aria Operations 8.x
Aria Lifecycle Manager 8.x

Cause

This issue typically occurs due to invalid data in the PID file located at: /storage/db/vcops/vpostgres/data/postmaster.pid

A valid postmaster.pid file will have contents similar to the following format:

Resolution

To resolve this issue, please follow the steps below:

1. 1. Take Snapshots

      • Take snapshots of all Aria Operations nodes before making any changes.

   2. Validate the postmaster.pid File

      • On the node where the vpostgres service is not running, check the file:

        cat /storage/db/vcops/vpostgres/data/postmaster.pid

   3. Stop Aria Operations Services
      
      Run the following command to stop all services:

      service vmware-vcops stop

   4. Backup the Existing postmaster.pid File
      
      Navigate to the directory and create a backup:

      cp /storage/db/vcops/vpostgres/data/postmaster.pid /storage/db/vcops/vpostgres/data/postmaster.pid.bak

   5. Remove the Stale postmaster.pid File
      
      Delete the PID file using:

      rm -rf /storage/db/vcops/vpostgres/data/postmaster.pid

   6. Start Aria Operations Services
      
      Restart all services by running:

      service vmware-vcops start

   7. Verify vPostgres Status

      • Use vrops-status or check the UI to confirm the vpostgres service is now running.

   8. LCM Upgrade Completion

      • After verifying that all services are healthy, you can proceed with the upgrade via Lifecycle Manager (LCM). It should now complete without any issues.