Error: An error occurred in task "Create Transport Node Collections" VCF 9.1 Brownfield deployment
search cancel

Error: An error occurred in task "Create Transport Node Collections" VCF 9.1 Brownfield deployment

book

Article ID: 446661

calendar_today

Updated On:

Products

VMware SDDC Manager / VCF Installer

Issue/Introduction

  • Deploying and configuring the NSX in a VMware Cloud Foundation (VCF) 9.1 brownfield environment fails. The installer UI reports: An error occurred in task "Create Transport Node Collections.



  • The /var/log/vmware/vcf/domainmanager/domainmanager.log on the VCF installer displays configuration errors indicating a failed or skipped vSphere Configuration Profiles (VCP) precheck for the cluster.

    YYYY-MM-DDTHH:MM:SSZ ERROR [vcf_dm,0000000000000000,0000] [c.v.v.v.v.VCPConfigurationHelper,dm-exec-2968]  Failed to configure VCP for cluster domain-c#
    java.lang.Exception: Draft configuration Precheck task failed or skipped on '<ESX1-FQDN>, <ESX2-FQDN>, <ESX3-FQDN>'.
            at com.vmware.vcf.vapi.vsphere.VCPConfigurationHelper.runPrecheckAndApplyDraft(VCPConfigurationHelper.java:395)
            at com.vmware.vcf.vapi.vsphere.VCPConfigurationHelper.configureVCPCluster(VCPConfigurationHelper.java:168)
            at com.vmware.vcf.common.fsm.plugins.nsxt.policy.action.CreateOverlayAndVlanBackedTransportNodeCollectionAction.lambda$execute$6(CreateOverlayAndVlanBackedTransportNodeCollectionAction.java:390)
            at java.base/java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1768)
            at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144)
            at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642)
            at java.base/java.lang.Thread.run(Thread.java:1583)
    YYYY-MM-DDTHH:MM:SSZ ERROR [vcf_dm,0000000000000000,0000] [c.v.v.c.f.p.n.p.a.CreateOverlayAndVlanBackedTransportNodeCollectionAction,dm-exec-2968]  VCP draft creation/apply failed for cluster <Cluster-Name> (MoId: domain-c#)
    com.vmware.evo.sddc.orchestrator.exceptions.OrchTaskException: Failed to create or apply VCP draft for the cluster domain-c# java.lang.Exception: Draft configuration Precheck task failed or skipped on '<ESX1-FQDN>, <ESX2-FQDN>, <ESX3-FQDN>'.
            at com.vmware.vcf.common.fsm.plugins.nsxt.policy.action.CreateOverlayAndVlanBackedTransportNodeCollectionAction.lambda$execute$6(CreateOverlayAndVlanBackedTransportNodeCollectionAction.java:397)
            at java.base/java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1768)
            at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144)
            at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642)
            at java.base/java.lang.Thread.run(Thread.java:1583)
    YYYY-MM-DDTHH:MM:SSZ ERROR [vcf_dm,6####################c,5##b] [c.v.v.c.f.p.n.p.a.CreateOverlayAndVlanBackedTransportNodeCollectionAction,dm-exec-2967]  Error in creating transport node collections
    java.util.concurrent.CompletionException: com.vmware.evo.sddc.orchestrator.exceptions.OrchTaskException: Failed to create or apply VCP draft for the cluster domain-c# java.lang.Exception: Draft configuration Precheck task failed or skipped on '<ESX1-FQDN>, <ESX2-FQDN>, <ESX3-FQDN>'.
            at java.base/java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:315)
            at java.base/java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:320)
            at java.base/java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1770)
            at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144)
            at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642)
            at java.base/java.lang.Thread.run(Thread.java:1583)
    Caused by: com.vmware.evo.sddc.orchestrator.exceptions.OrchTaskException: Failed to create or apply VCP draft for the cluster domain-c# java.lang.Exception: Draft configuration Precheck task failed or skipped on '<ESX1-FQDN>, <ESX2-FQDN>, <ESX3-FQDN>'.
            at com.vmware.vcf.common.fsm.plugins.nsxt.policy.action.CreateOverlayAndVlanBackedTransportNodeCollectionAction.lambda$execute$6(CreateOverlayAndVlanBackedTransportNodeCollectionAction.java:397)
            at java.base/java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1768)
            ... 3 common frames omitted
    YYYY-MM-DDTHH:MM:SSZ ERROR [vcf_dm,6a26f5cda0716ffd62426852d5c7829c,5d4b] [c.v.e.s.o.model.error.ErrorFactory,dm-exec-2967]  [<Reference-Token>] NSX_TNC_CONFIG_ERROR_GENERIC Error in configuring transport node collections
    com.vmware.evo.sddc.orchestrator.exceptions.OrchTaskException: Error in configuring transport node collections
    .
    .
    .
    Caused by: java.util.concurrent.CompletionException: com.vmware.evo.sddc.orchestrator.exceptions.OrchTaskException: Failed to create or apply VCP draft for the cluster domain-c# java.lang.Exception: Draft configuration Precheck task failed or skipped on '<ESX1-FQDN>, <ESX2-FQDN>, <ESX3-FQDN>'.

  • Importing the configuration draft from an ESX host and running a manual pre-check on the vCenter Server returns validation failures regarding dynamicruleset firewall rules or nmp_claim_rules storage rules.

  • Manually editing the configuration draft to remove dynamicruleset and nmp_claim_rules allows the pre-check to succeed. However, the remediation phase fails when applying the draft with the following error: Apply plugin 'REMEDIATE:esx:storage:nmp_claim_rules' failed.

Environment

  • VMware Cloud Foundation (VCF) 9.x
  • VMware vCenter 9.x
  • VMware ESX 9.x

Cause

In VMware Cloud Foundation (VCF) 9.1, the Deploy and Configure NSX workflow for brownfield imports relies on vSphere Configuration Profiles (VCP) to ensure all hosts in a cluster meet a desired state before NSX Transport Node Collections (TNC) can be realized.

A circular conflict occurs during the cluster configuration extraction and validation process. During brownfield import, VCP extracts a configuration draft from a reference ESXi host. If that host has system services enabled or third-party storage drivers, the extraction process erroneously includes system-owned objects specifically dynamicruleset firewall rules and nmp_claim_rules storage rules into the user-editable configuration draft. ESXi treats these objects as system-protected and prohibits manual modification via external JSON profiles, halting the NSX deployment.

Resolution

  1. Remove the dynamicruleset and nmp_claim_rules configurations from the vCenter configuration draft.
  2. Take a configuration backup of all ESX hosts within the target cluster.
  3. Remove the NMP claim rules from each ESX host using the following command: configstorecli config current delete -c esx -g storage -k nmp_claim_rules --all
  4. Retry and proceed with the deployment on the VCF Installer to proceed past the Deploy and Configure NSX stage.

Additional Information