VCF 9.1 Deployment Fails at "Create NSX Transport Node Collection" Due to Unsupported OS Version.

Products

• VMware SDDC Manager / VCF Installer
• VMware Cloud Foundation

Issue/Introduction

• VMware Cloud Foundation (VCF) 9.1 deployment fails during the Deploy and Configure NSX task, specifically at the Create Transport Node Collection subtask.
• The following error is observed in the VCF installer UI:
  
  

  One or more transport node(s) realization failed while creating the transport node collection with profile [PROFILE_ID] on compute collection [DOMAIN_ID] through NSX Manager [NSX_MANAGER_FQDN]. Remediation: Check the error(s) on NSX Manager and resolve them before restarting the failed task. Reference Token: #####

• /var/log/vmware/vcf/domainmanager/domainmanager.log on VCF installer reports below error stack:
  
  

  YYYY-MM-DDTHH:MM DEBUG [vcf_dm,########-####-####-####-############,####] [c.v.v.c.n.s.i.NsxtTransportNodeCollectionPolicySdkService,dm-exec-####]  Transport Node Collection input before creation {"id":"########-####-####-####-############","resourceType":"HostTransportNodeCollection","tags":[{"scope":"vcf-orchestration/vm-mgmt-dvpg-moid","tag":"dvportgroup-##"},{"scope":"vcf-orchestration/mgmt-gw-cidr-ipv4","tag":"
  ##.##.##.#/##"},{"scope":"vcf-orchestration/mgmt-dvpg-moid","tag":"dvportgroup-##"},{"scope":"vcf-orchestration/primary-ds-moid","tag":"datastore-##"}],"computeCollectionId":"########-####-####-####-############:domain-##","transportNodeProfileId":"/infra/host-transport-node-profiles/########-####-####-####-############"}
  YYYY-MM-DDTHH:MM  DEBUG [vcf_dm,########-####-####-####-############,####] [c.v.v.c.n.s.c.c.ApiConnection,dm-exec-####]  Closed ApiClient connection.
  YYYY-MM-DDTHH:MM  DEBUG [vcf_dm,########-####-####-####-############,####] [c.v.v.c.n.s.c.c.ApiConnection,dm-exec-####]  Closed ApiClient connection.
  YYYY-MM-DDTHH:MM ERROR [vcf_dm,########-####-####-####-############,####] [c.v.v.c.f.p.n.p.a.CreateTransportNodeCollectionAction,dm-exec-####]  Exception occurred while creating transport node collection using profile ########-####-####-####-############ on the cluster(with compute collection) ########-####-####-####-############:domain-##
  com.vmware.vapi.std.errors.InvalidRequest: InvalidRequest (com.vmware.vapi.std.errors.invalid_request) (statusCode:400) => {
      messages = [],
      data =  => {error_message=Cluster contains host esx.example.com which is of unsupported OS version so applying transport node profile is not allowed., httpStatus=BAD_REQUEST, error_code=26002, module_name=service-installation-fabric},
      errorType = INVALID_REQUEST

Environment

• VMware Cloud Foundation 9.1

Cause

The ESXi hosts are running version 9.0.2, while SDDC Manager, NSX, and vCenter are version 9.1.

Resolution

To resolve this issue, the ESXi hosts must be upgraded to version 9.1.x to match the VCF environment.