ESXi host service account 'svc-vcf-esxi_####' is disconnected in SDDC manager Password Management

Products

• VMware SDDC Manager
• VMware Cloud Foundation

Issue/Introduction

• The 'Remediate Password' option is non-functional, and the ESXi host for the service account 'svc-vcf-<esxi_shortname>' is showing a 'Disconnected' status.
• Can see below in var/log/vmware/vcf/operationsmanager/operationsmanager.log

  • [YYYY-MM-DDTHH:MM:SS] ERROR [vcf_om,####,d24e] [c.v.e.s.c.c.v.vsphere.VcManagerBase,om-exec-28] Cannot complete login due to incorrect credentials: ####.####.com, svc-vcf-##-##-esx##.
    [YYYY-MM-DDTHH:MM:SS] ERROR [vcf_om,####,d24e] [c.v.v.p.h.EsxiHostCommandExecutor,om-exec-28] Exception occured in fetching lockdown mode status on ESXi host: ####.####.com, via a connection using service-account : {
    [YYYY-MM-DDTHH:MM:SS] ERROR [vcf_om,####,d24e] [c.v.e.s.c.c.v.vsphere.VcManagerBase,om-exec-28] Cannot complete login due to incorrect credentials: ####.####.com, svc-vcf-##-##-esx##.
    [YYYY-MM-DDTHH:MM:SS] ERROR [vcf_om,####,d24e] [c.v.v.p.h.EsxiHostCommandExecutor,om-exec-28] Exception occured in getting connection to ESXi host : ####.####.com using a connection via: svc-vcf-##-##-esx##, {}

• The ESXi host lockdown mode is disabled.
• The ESXi Host does not have special characters.
  • Ref: https://knowledge.broadcom.com/external/article/383098 

Cause

• If the host has been rebuilt/reconfigured and then re-added to the vCenter without going through the decommission/commission process from the SDDC Manager, the service account may be missing on the ESXi host.
• svc-vcf-esxi_#### service account is missing in the ESXi host.

Resolution

• Since the svc-vcf-esxi_shortname account is missing, manually re-create the service account on the ESXi host.
  • Ref: Re-create missing SDDC Manager Service account on an ESXi host

Additional Information

• SDDC components are disconnected in Password Management, remediation fails with "javax.net.ssl.SSLHandshakeException: PKIX path validation failed"
• Missing ESXi service accounts in SDDC Manager after Bringup
• Remediate password task in SDDC Manager UI fails if the password has specific special characters
• vCenter SDDC Service Accounts show disconnected in SDDC Manager UI