Errands of any tiles fails with error "system_services user credentials rejected"

Products

• VMware Tanzu Application Service

Issue/Introduction

While upgrading or installing any tile which uses the "system_service" user of the TAS will fail with below error.

cf auth system_services **********

Credentials were rejected, please try again.

Environment

TAS 
Redis

Cause

This is due to the user "system_services" account is locked.

Validate the user and password using Cf cli.

Username and password can be fetched from the TAS tile under UAA

cf auth system_services erf_-xrttxyfrfggoAfrfrfrflkjnjkJHKBK
API endpoint: https://example.com
Authenticating...
Your account has been locked because of too many failed attempts to login.
FAILED
 

This means some client is trying to authenticate the user "system_services" with the wrong password.

To identify the client is trying to authenticate, check the UAA logs of the TAS deployment.

Resolution

Unlock the "system_services" user using the UAAC.

uaac target example.com --skip-ssl-validation

uaac token client get admin -s "password"

uaac user unlock system_services