Workload Management shows "We encountered an error and are unable to reach the service" in vCenter Server

Products

• VMware vSphere ESXi
• VMware vSphere Kubernetes Service

Issue/Introduction

1. One of the following error messages are seen in Workload Management in vSphere:
   "None of the hosts connected to this vCenter are licensed for Workload Management"
"We encountered an error and are unable to reach the service"
   
   
2. Tanzu Kubernetes Clusters are not visible in vSphere inventory.
   
   
3. The below entries are present in /var/log/vmware/wcpsvc.log:
   YYYY-MM-DDTHH:MM:SSZ debug wcp [ssolib/sts.go:87] [opID=63c89b11] Getting HOK signer; store: wcp, alias: wcp
YYYY-MM-DDTHH:MM:SSZ error wcp [ssolib/sts.go:122] [opID=63c89b11] STS Issue HOK request failed; err: ns0:FailedAuthentication: Invalid credentials
YYYY-MM-DDTHH:MM:SSZ error wcp [kubelib/auth.go:115] [opID=63c89b11] Failed to obtain JWT for wcp: ns0:FailedAuthentication: Invalid credentials
YYYY-MM-DDTHH:MM:SSZ error wcp [kubelib/auth.go:160] [opID=63c89b11] Failed to obtain JWT: ns0:FailedAuthentication: Invalid credentials
YYYY-MM-DDTHH:MM:SSZ debug wcp [kubelib/auth.go:203] [opID=63c89b11] Auth roundtripper: retry request. Response statusCode: 401
   
   
4. The below entries are present in /var/log/vmware/sso/vmware-identity-sts.log:
   YYYY-MM-DDTHH:MM:SSZ INFO sts[77:tomcat-http--39] [CorId=49e3e12e-####-####-####-##########93] [com.vmware.identity.sts.ws.SOAPFaultHandler] Returning a SOAP Fault with code: ns0:FailedAuthentication and description: Invalid credentials
YYYY-MM-DDTHH:MM:SSZ INFO sts[84:tomcat-http--46] [CorId=62b603b1-####-####-####-##########fe] [com.vmware.identity.sts.ws.SOAPFaultHandler] Returning a SOAP Fault with code: ns0:FailedAuthentication and description: Invalid credentials
YYYY-MM-DDTHH:MM:SSZ INFO sts[77:tomcat-http--39] [CorId=49e3e12e-####-####-####-##########93] [com.vmware.identity.sts.InvalidCredentialsException] Censored exception com.vmware.identity.sts.InvalidCredentialsException: Solution user cert is not valid.

Environment

VMware vSphere 7.0 with Tanzu

Cause

The WCP Solution User certificate is expired.

Resolution

Regenerate the solution user certificate using vCert - Scripted vCenter expired certificate replacement.