Aria Operations Password Rotation Fails in SDDC Manager with Error LCMVACONFIG80003

Products

• VCF Operations/Automation (formerly VMware Aria Suite)

Issue/Introduction

• Aria Operations password rotate tasks initiated from SDDC Manager fail with the error LCMVACONFIG80003 within VMware Aria Suite Lifecycle (LCM).
  
  
• The SDDC Manager interface displays the following error during the workflow:

Password rotate for resource : <Aria_operations_node_fqdn>, user : root and credential type : SSH
Failed to update Environment in VMware Aria Suite Lifecycle because of error response.
Error Message: Failed to update Environment in VMware Aria Suite Lifecycle because of error response.
Remediation Message: Reference Token: #####
Cause: Failed to update the password. You can send a new password update request by making sure the current password is correct and the new password has not been already used.

• In Aria Suite Lifecycle, the password update request fails with the following exception:

Error Code : 'LCMVACONFIG80003'
com.vmware.vrealize.lcm.common.exception.userinput.VAPasswordUpdateFailedException: Failed to update the password for <Aria_operations_node_fqdn>

• Additionally, the /var/log/vrlcm/vmware_vrlcm.log file on the LCM appliance reports socket timeout failures:

  java.lang.RuntimeException: Cannot execute ssh commands. Exception encountered : timeout: socket is not established 
  Caused by: java.lang.RuntimeException: Cannot create session for ssh://root@<Aria_operations_node_fqdn> 
  Caused by: com.jcraft.jsch.JSchException: timeout: socket is not established

Environment

VMware Cloud Foundation 5.x

SDDC Manager 5.x

VMware Aria Suite Lifecycle 8.18

VMware Aria Operations 8.18.x

Cause

The password rotation failure is caused by an underlying DNS name resolution failure on the VMware Aria Suite Lifecycle Manager appliance, preventing it from resolving the FQDN of the target Aria Operations nodes. The password rotation workflow relies strictly on FQDN communication to securely connect to target appliances over SSH; if DNS fails, the SSH handshake times out.

Resolution

To resolve this issue permanently:

1. Remediate the underlying name resolution issue within the authoritative DNS servers servicing the SDDC Manager and LCM management network infrastructure.

2. Ensure correct forward lookup mapping is established for all Aria Operations cluster nodes.

To implement a temporary workaround if DNS cannot be immediately remediated:

1. Establish an SSH session to the VMware Aria Suite Lifecycle Manager appliance as the root user.

2. Open the /etc/hosts file using a text editor (e.g., vi /etc/hosts).

3. Manually append the explicit IP-to-FQDN mapping entries for the affected Aria Operations nodes. 

   ###.###.###.### node-fqdn.example.com

4. Save and close the /etc/hosts file.

5. Re-initiate the "Rotate Password" workflow from the SDDC Manager interface.
   
   
   

If the issue persists, see Contact Broadcom Support for further assistance.

Additional Information

• For information on managing support cases, see Creating and Managing Broadcom Support Cases.