Postgres cluster Health is critical for VMware Identity Manager in VMware Aria Suite Lifecycle

Products

• VCF Operations/Automation (formerly VMware Aria Suite)

Issue/Introduction

• VMware Aria Suite Lifecycle may report the following warning for VIDM:

  VMware Identity Manager Postgres Cluster Health
  A Remediation would cause a downtime.
  VMware Identity Manager Postgres Health is critical. pgpool status for nodes in the cluster are neither 'MASTER' nor
  'STANDBY'
  The cluster health will be remediated by powering on (if Powered off) all nodes to address this issue. For More
  information: View detailed steps in KB

• VMware Identity Manager nodes in vCenter may not be booted up correctly 
• VMware Identity Manager postgres cluster health status is "Critical" in vRLCM but show as healthy in VMware Identity Manager System Diagnostics dashboard

• VMware Aria Suite Lifecycle may report the following error in the UI when remediating the VMware Identity Manager cluster LCMVIDM74066: Failed to create a pgpool back-end connection, as failover is executing in the backend  with the the error block showing the following entries : 

  Failed to create a pgpool back-end connection, as failover is executing in the backend. Refer to VMware Aria Suite Lifecycle logs for additional details.
  Unable to execute the command - " su postgres -c "echo -e [Password]|/opt/vmware/vpostgres/current/bin/psql -h localhost -p 9999 -U pgpool postgres -c \"show pool_nodes\""" on <VIDMFQDN>. Replace '<Password>' in the command with password from the file available in the vIDM host at /usr/local/etc/pgpool.pwd. If the file is not found, use the default pgpool password.. Ensure pgpool and postgres services are up in all the nodes and retry. Refer to KB : https://kb.vmware.com/s/article/75080 to bring up postgres and pgpool service.

Environment

VMware Identity Manager 3.3.x

Resolution

Note: Take a snapshot of all VMware Identity Manager nodes prior to applying below steps as per KB How to take a Snapshot of VMware Identity Manager

1. Ensure that root and sshuser passwords for all VMware Identity Manager nodes are not expired as per KB How to change Expired Password for "root" and "sshuser" in VMware Identity Manager 
2. Confirm that the passwords in the VMware Aria Suite Lifecycle Locker match the current appliance passwords.
3. Complete a graceful shutdown and power on of all VMware Identity Manager nodes using the Aria Lifecycle Method as per the steps outlined under in KB Graceful Shutdown and Power On of a VMware Identity Manager PostgreSQL cluster
4. Run a remediation on the cluster after a reboot.  If remediation continues to fail with the error code LCMVIDM74066 please apply KB The LCM remediation on vIDM failed with error LCMVIDM74066

Additional Information

If you continue to have an issue recommend to review kb Troubleshooting VMware Identity Manager postgres cluster deployed through vRealize Suite Lifecycle Manager

As always take snapshots of all VMware Identity Manager nodes before making changes