Creating cluster on WLD fails with "Error occurred while generating input for add hosts in cluster in NSX environment"

Products

• VMware SDDC Manager / VCF Installer

Issue/Introduction

• Creating cluster fails on step/work-flow "Gather input to add host to NSX Fabric and configure overlay networking on VDS" with error, 
  Error occurred while generating input for add hosts in cluster in NSX environment
Message: Error occurred while generating input for add hosts in cluster in NSX environment
Remediation Message:
Reference Token: XXXXX
Cause: Unable to find anyhealth of the hosts from the list of hosts : esx01.example.com,esx02.example.com,esx03.example.com,esx04.example.com
   
• In SDDC Manager /var/log/vmware/vcf/domainmanager/domainmanager.log:
YYYY-MM-DDTHH:MM:SS ERROR [vcf_dm,689550e691188139a9824960a16c6373,22fd] [c.v.v.c.f.p.n.a.NsxtAddClusterHeader,dm-exec-17]  Error occurred while generating input for add hosts in cluster in NSX environment
java.lang.IllegalStateException: Unable to find anyhealth of the hosts from the list of hosts : esx01.example.com,esx02.example.com,esx03.example.com,esx04.example.com
at com.vmware.vcf.common.fsm.plugins.nsxt.helpers.NsxtDomainResourceStateHelper.lambda$getAhealthyHost$7(NsxtDomainResourceStateHelper.java:489)
at java.base/java.util.Optional.orElseThrow(Optional.java:403)
at com.vmware.vcf.common.fsm.plugins.nsxt.helpers.NsxtDomainResourceStateHelper.getAhealthyHost(NsxtDomainResourceStateHelper.java:486)
at com.vmware.vcf.common.fsm.plugins.nsxt.action.NsxtAddClusterHeader.execute(NsxtAddClusterHeader.java:258)
at com.vmware.vcf.common.fsm.plugins.nsxt.action.NsxtAddClusterHeader.execute(NsxtAddClusterHeader.java:71)
at com.vmware.evo.sddc.orchestrator.platform.action.FsmActionState.invoke(FsmActionState.java:62)

• The hosts in this case i.e. "esx01.example.com,esx02.example.com,esx03.example.com,esx04.example.com"  were in powered off state.

Environment

SDDC 4.x
SDDC 5.2.x

Cause

VCF workflows (Upgrade, Add Cluster, etc.) perform a comprehensive health check across the SDDC stack. A failure will occur if any of the following entities report an unhealthy status:

• vCenter Server (VC)
• ESXi Hosts
• NSX Manager/Edges

Resolution

• This issue has been fixed in VCF 9.0.
• Future SDDC version version will have the fix.
  
  Work-around:
  Have at least one host in powered ON state and re-run the task. (Not all hosts needs to be powered on).