DSM operations start but do not complete due to expired Provider root password

Products

• VMware Data Services Manager for VCF

Issue/Introduction

When attempting to perform management operations in VMware Data Services Manager (DSM), such as Delete or Clone a database, the tasks remain in a 'Deleting' or 'InProgress' state indefinitely.

Additional observed symptoms may include:

• DSM UI show the Critical alerts as below under Global Alerts.

'Provider root user password expired Appliance (OS) root password is expired. Please contact the System administrator.'

• vCenter plugin registration check failures or the plugin showing as not registered.

'vCenter plugin is not registered - vCenter plugin registration check failed. Generate a log bundle and contact Broadcom support.'

• Database monitoring reporting that metrics collection failed with below event under Databases > Monitoring > Alerts.

'Data Services Manager is not receiving metrics from the Dataservice cluster'

Environment

• VMware Data Services Manager 2.2.x
• VMware Data Services Manager 9.x
• Expired DSM provider root password.

Cause

• The root password for the DSM Provider appliance has expired at the OS level. When the root password expires, the automated service accounts and management APIs cannot authenticate to perform backend operations.

• If service account passwords were rotated while the root account was expired, the new credentials may fail to sync correctly, leading to a flood of invalid login attempts toward vCenter.

Resolution

In order to resolve the issue, reset the root password for the DSM provider.

1. The KB Resetting the Root Password on VMware Data Services Manager Appliance contains the instructions for resetting the root password with different scenarios.

2. Post resetting the root password, the pod reconciliation is expected to happen automatically and all the management operations would work as expected.