VMware Cloud Foundation Workload domain creation fails at Check Host network Configuration

Products

• VMware Cloud Foundation

Issue/Introduction

The article provides instructions to troubleshoot the Host Network Configuration errors.

Symptoms:

• Workload domain creation fails with ERROR :Exception in task: vCenter: Check Host Network Configuration.
• You see errors similar to following in the /home/vrack/vrm/logs/vrack-vrm-debug.log​

YYYY-MM-DD HH:mm:ss [pool-23-thread-4] INFO  [com.vmware.vrack.vrm.vsphere.HostManager] Connecting to standalone host xxx.xxx.xxx.xxx
YYYY-MM-DD HH:mm:ss[pool-23-thread-4] INFO  [com.vmware.vrack.vrm.vsphere.VsphereClient] Successfully login to https://xxx.xxx.xxx.xxx/sdk
YYYY-MM-DD HH:mm:ss [pool-23-thread-4] INFO  [com.vmware.vrack.vrm.vsphere.VsphereUtils] ESXi Host thumbprint: C4:34:8B:38:77:DA:6D:FD:26:B9:77:F4:51:82:BB:38:31:2A:C7:34
YYYY-MM-DD HH:mm:ss [pool-23-thread-4] DEBUG [com.vmware.vrack.vrm.workflow.tasks.vsphere.CheckHostNetworkTask] Added vSwitch : vSwitch0
YYYY-MM-DD HH:mm:ss [pool-23-thread-4] INFO  [com.vmware.vrack.vrm.workflow.tasks.vsphere.CheckHostNetworkTask] Verifying standard switch on host xxx.xxx.xxx.xxx
YYYY-MM-DD HH:mm:ss [pool-23-thread-4] INFO  [com.vmware.vrack.vrm.workflow.tasks.vsphere.CheckHostNetworkTask] Verifying in-use vmnic on host xxx.xxx.xxx.xxx
YYYY-MM-DD HH:mm:ss [pool-23-thread-4] INFO  [com.vmware.vrack.vrm.vsphere.HostProxy] Listing vmnics [vmnic3, vmnic2] under standard switch vSwitch0
YYYY-MM-DD HH:mm:ss [pool-23-thread-4] INFO  [com.vmware.vrack.vrm.vsphere.HostProxy] Disconnecting host xxx.xxx.xxx.xxx
2YYYY-MM-DD HH:mm:ss [pool-23-thread-4] ERROR [com.vmware.vrack.vrm.core.engine.SimpleWorkflowEngine] Exception in task: vCenter: Check Host Network Configuration for Workflow 8f2f9264-2626-4b7b-b741-f3e588c223e9-0
com.vmware.vrack.vrm.workflow.tasks.TaskException: Expect only 1 vmnic under standard switch vSwitch0 on host xxx.xxx.xxx.xxx but it is 2
        at com.vmware.vrack.vrm.workflow.tasks.vsphere.CheckHostNetworkTask.run(CheckHostNetworkTask.java:57)
        at com.vmware.vrack.vrm.core.engine.SimpleWorkflowEngine.executeTask(SimpleWorkflowEngine.java:550)
        at com.vmware.vrack.vrm.core.engine.SimpleWorkflowEngine.runSingleTask(SimpleWorkflowEngine.java:501)
        at com.vmware.vrack.vrm.core.engine.SimpleWorkflowEngine.access$1000(SimpleWorkflowEngine.java:47)
        at com.vmware.vrack.vrm.core.engine.SimpleWorkflowEngine$2.run(SimpleWorkflowEngine.java:311)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.UnsupportedOperationException: Expect only 1 vmnic under standard switch vSwitch0 on host xxx.xxx.xxx.xxx but it is 2
        at com.vmware.vrack.vrm.workflow.tasks.vsphere.CheckHostNetworkTask.verifyInUseVmnic(CheckHostNetworkTask.java:108)
        at com.vmware.vrack.vrm.workflow.tasks.vsphere.CheckHostNetworkTask.verifyHostNetworkConfig(CheckHostNetworkTask.java:87)
        at com.vmware.vrack.vrm.workflow.tasks.vsphere.CheckHostNetworkTask.run(CheckHostNetworkTask.java:54)
        ... 7 common frames omitted
YYYY-MM-DD HH:mm:ss [pool-23-thread-4] DEBUG [com.vmware.vrack.vrm.workflow.tasks.vsphere.CheckHostNetworkTask] TASK vCenter: Check Host Network Configuration, status changed FAILED
YYYY-MM-DD HH:mm:ss [pool-25-thread-8] DEBUG [com.vmware.evo.sddc.monitoring.event.client.impl.EventClientImpl] Inside event client library sync mechanism
YYYY-MM-DD HH:mm:ss [pool-25-thread-8] DEBUG [com.vmware.vrack.vrm.event.service.impl.EventServiceAdaptorImpl] Inside pushEvent
YYYY-MM-DD HH:mm:ss [pool-25-thread-8] DEBUG [com.vmware.vrack.vrm.event.service.impl.EventServiceImpl] Received new Event DOMAIN_TASK_FAILED. Total number of events received by event-service from VRM start: 2705
YYYY-MM-DD HH:mm:ss [pool-23-thread-4] DEBUG [com.vmware.vrack.vrm.core.engine.Workflow] Changing the status from RUNNING_TASK to FAILED
 

Note: The preceding log excerpts are only examples. Date, time, and environmental variables may vary depending on your environment.

Environment

VMware Cloud Foundation 2.x

Cause

Issue results from ESXI Management Network issues.

Resolution

In order to resolve this error, perform the following steps: 

1. Log in to the DCUI of the particular host using root credentials.
2. Go to Configure Management Network and press Enter.
3. Hit Enter on Network Adapters and check How many vmnic are selected.
4. Select vmnic0 & deselect vmnic1 if selected.
5. Hit Escape and Hit Enter on Restart Management Network.
6. Re-Initiate the failed workflow in SDDC Manager UI, Once the Management network is restarted.

Additional Information

Impact/Risks:
Ensure that the error in the logs match with the above snippets before proceeding further.