The VCF installer was failing with an error of "VCF Operations first boot failed Reference Token" seen in the VCF Installer GUI.
In the logs the same following in domainmanager.log:
VCF_OPS_FIRST_BOOT_FAILED VCF Operations first boot failed com.vmware.evo.sddc.orchestrator.exceptions.OrchTaskException: VCF Operations first boot failed
VCF 9
Ran VDT on vCenter and pointed to issues with DNS.
Error logged as follows:
DNS with TCP – testing if xxxx.xxx.xxx resolves to 192.xx.xx.xx VC uses TCP 53 for DNS queries when UDP fails, or if the size is too large for a single UDP packet
Customer will need to work with their Networking team to resolve DNS issues.
The issue was their firewall and opening the port 53 for DNS.
ESXi hosts intermittently show "Not Responding" in vCenter when TCP port 53 is blocked