Unable to access Workload Management in vSphere UI

Products

• VMware vCenter Server 7.0

Issue/Introduction

^{Unable to access Workload Management in vSphere UI because the WCP service failed to start.}

^{WCP core dump files are written to /var/core} 

^{/var/log/vmware/wcp/wcpsvc.log contains the following entries:}

^{YYYY-MM-DD error wcp [crypto/cryptography.go:###] [opID=domain-c#] Unable to decrypt input of length: 0} 

^{YYYY-MM-DD error wcp [crypto/cryptography.go:###] [opID=domain-c#] AES decryption GCM Mode failed due to: <nil>, Decryption failed. Retrying CBC} 

^{YYYY-MM-DD error wcp [crypto/cryptography.go:###] [opID=domain-c#] AES decryption CBC Mode failed due to: encrypted text is incorrect} 

^{YYYY-MM-DD error wcp [crypto/cryptography.go:###] [opID=domain-c#] Cannot decrypt input: encrypted text is incorrect} 

^{YYYY-MM-DD error wcp [kubelifecycle/kube_instance_db.go:###] [opID=domain-c#] Failed to decrypt Netoperator service account password: encrypted text is incorrect}

^{YYYY-MM-DD debug wcp [kubelifecycle/spherelet.go:###] [opID=domain-c#] Selected spherelet version 1.3.6-21136025 for desired version v1.23.12+vmware.wcp.1-vsc0.0.24-22240436}

Environment

^{VMware vCenter Server 7.x}

Resolution

^{Identify the impacted cluster by analysing the above WCP log snippets.}  

^{Establish a PuTTY session to the ESXIs in the cluster.}

^{Run the following command:}

^{esxcli software vib list | grep -i spherelet}

^{spherelet version should be less than 1.3.6}

^{To resolve the issue, please update all the ESXIs in the cluster to ESXi 7.0 Update 3p}