A Virtual Infrastructure workload domain creation workflow fails at task "NSX: Configure VXLAN"

Products

• VMware Cloud Foundation

Issue/Introduction

In a VMware Cloud Foundation environment, when you run the Virtual Infrastructure (VI) workload domain creation workflow, you experience the following symptoms:

• The task "NSX: Configure VXLAN" fails.
• Clicking Restart Workflow does not successfully continue past the failed task. The task continues to fail.
• The evosddc-debug-*.log file contains messages indicating that the NSX job for this task timed out:

[pool-35-thread-9] ERROR [com.vmware.vrack.vrm.workflow.tasks.AbstractNsxTask] NSX: Configure VXLAN [ConfigureVxlanTask]: failed. NSX job jobdata-54 timeout
[pool-35-thread-9] ERROR [com.vmware.vrack.vrm.core.engine.SimpleWorkflowEngine] Exception in task: NSX: Configure VXLAN for Workflow d1d615d0-cb3c-4344-84f2-05027ac09fd9-0
com.vmware.vrack.vrm.workflow.tasks.TaskException: NSX job jobdata-54 timeout

 

Resolution

Cause:
This issue is that the workflow task triggers a VXLAN configuration job on the NSX Manager that successfully configures the VXLAN but then hangs and never exits. As a result, the workflow task times out (NSX job timeout). When you click Restart Workflow, SDDC Manager tries to run the task NSX: Configure VXLAN over again. During that retry, the task fails because the VXLAN is already configured.

Resolution:
This issue has been resolved in 2.2 version and later of product. Available at  VMWare Downloads. https://customerconnect.vmware.com/en/web/vmware/info/slug/datacenter_cloud_infrastructure/vmware_cloud_foundation/2_3


To workaround this issue, unconfigure the VXLAN that was configured for the VI workload domain, reboot the NSX Manager virtual machine, and restart the workflow.

Workaround Steps:

1. Launch the vSphere Web Client to the in-progress VI workload domain's vCenter Server cluster.
2. Navigate to Networking & Security > Installation > Host Preparation.
3. On the Host Preparation tab, use the drop-down to select the NSX Manager that was deployed for the VI workload domain. The corresponding cluster is displayed.
4. In the VXLAN column for that entry, select the green check mark so that the gear icon is displayed for that entry.
5. Click the gear icon and select Unconfigure VXLAN.
6. When the activity is completed, locate the NSX Manager virtual machine that was deployed for the VI workload domain and reboot it.
7. After that NSX Manager VM is up and running, return to the SDDC Manager client and click Restart Workflow to restart the VI workload domain creation workflow.