Getting error “Password management operation failed in pre-validation Stage”

Products

• VMware SDDC Manager / VCF Installer
• VCF Operations

Issue/Introduction

When a user is performing password management tasks such as Rotate/Update/Remediate, the operation fails with one of the following errors.

• “Password management operation failed in pre-validation Stage”.
• "Password management operation failed".

Task "Health-Check operation for..." with Subtask of "Pre-validation [Validate Source, Validate Disk Space, Verify Inventory..." shows status "Failed".

In the Fleet Management > Passwords view within VCF Operations 9.0.x environment, password remediation tasks (such as NSX Manager audit user) appear stuck "in progress" or show "failed"

• The error banner may be present while still being able to perform password management tasks without issues.

Environment

• VCF 5.x
• VCF Operations 9.0.x
• Fleet Management 9.0.x

Cause

Stale status entries in the SDDC database.

• DB records listed include transaction_status='PREVALIDATION_FAILED' or 'FAILED'.

Resolution

If account passwords for nodes have expired and showing as disconnected in SDDC manager follow the steps within KB Root user account is disconnected in SDDC Manager password management and wait some time for syncing to complete. Proceed with attempting to cancel the current task. If the cancellation is successful, the banner showing the "Retry or Cancel" options should disappear. This will then allow you to run the password task.

If you encounter this issue and the steps above do not resolve the issue please follow the steps below.

1. Engage Broadcom technical support. See Contact Support.
2. Provide the SDDC SOS log bundle Refer KB - Collecting SDDC Manager and VMSP logs
3. Reference this article regarding the requirement for database cleanup.