'CRITICAL PROBLEM' shown when viewing the cluster health on VAMI page

Products

• VMware Cloud Director

Issue/Introduction

• VCD UI unavailable from primary cell 
• postgres db service failing to start
  

  systemctl status vpostgres

• 'CRITICAL PROBLEM' shown when viewing the cluster health on problematic cell's VAMI page
  
  
  • It can be seen by accessing https://CELL1_FQDN:5480
• No sign of permissions' issue when following CRITICAL PROBLEM shown when viewing the cluster health on a VMware Cloud Director appliance
• While accessing VAMI page from a different cell we can see:
  • status is 'HEALTHY' (Green)
  • a new cell was promoted to primary
  • old primary is no longer displayed

Environment

10.4.2

Cause

• Primary cell crashed/got corrupted
• Standby cell took over it's place
• Cell became stale and db no longer in sync

Resolution

• Redeploy a fresh new cell and provide old Primary cell's information
  
  OR
• Clone the db from the primary cell and rejoin cell to cluster following this KB