Management domain passwords intermittently blank in VCF Operations Fleet Management UI

Products

• VCF Operations/Automation (formerly VMware Aria Suite)

Issue/Introduction

• When navigating to Fleet Management → Passwords, expanding the VCF instances, and selecting vCenter, the password management component details intermittently fail to load and display as blank
• Receiving an email alert that the vCenter password is due to expire
• When the component details do appear updating the password fails with the following error  in VCF Operations UI:

  Update for appliance <vCenterfqdn> has failed. Failed to perform specified operation on SDDC manager.

• Attempting to update passwords under Fleet Management in the VCF Operations UI triggers a corresponding task error in SDDC manager:
  

  Message: Resources [vcenter] are not available/ready. Remediation Message: Reference Token: #### Cause: Resources: [vcenter not in ACTIVE state

Environment

• VCF Operations 9.0.x
• SDDC manager 9.0.x

Cause

The vCenter resource status in the SDDC Manager platform database is incorrectly marked as 'FAILED' or 'INACTIVE', preventing the VCF Operations UI from retrieving or updating password data.

Resolution

1. Log in to the SDDC Manager appliance via SSH as the vcf user and switch to root.
2. Check the current status of vCenter in the platform database: 

   psql -h localhost -U postgres -d platform -c "select id, status, vm_hostname from vcenter where status!='ACTIVE';"

3. If the status indicates 'Failed' or 'Inactive' , perform these steps:
   1. Restart the VMware Cloud Foundation (VCF) operations manager service:

      systemctl restart operationsmanager

       

   2. Restart the Common Services microservice: 

      systemctl restart commonsvcs

4. Wait 5 minutes and retry the password update or remediation task from the VCF Operations UI.
5. If the status remains unchanged in the database, follow the manual remediation steps in KB Password Remediation in VCF fails with "Resources are not in available/ready"