VM Looses Network connectivity and TX Hang on the VMXNET3
search cancel

VM Looses Network connectivity and TX Hang on the VMXNET3

book

Article ID: 413495

calendar_today

Updated On:

Products

VMware vSphere ESXi

Issue/Introduction

  • VM will loose Network connectivity Below error are seen on the vmkernel.log on the ESXi Host.
    2025-09-27T06:24:19.099Z cpu12:2097276)Vmxnet3: 2###1: <VM_NAME>.eth<numb>,00:50:5#:##:##:de, portID(16#####31): Hang detected,numHangQ: 1 enableGen: 6626
  • We see vdr conn info is updated before the tx Hang
    2025-09-27T06:24:08.066Z cpu23:2103517 opID=405842a7)NetDVS: 9066: Failed to clear host property com.vmware.common.host.volatile.upgrade70OrLater on DVS 50 ## ## ## ## ## ## ##-## ## ## ## ## ## ## 6f as it is not set.
    2025-09-27T06:24:09.088Z cpu60:2103476 opID=d8df505e)World: 1###7: VC opID 3f####b5 maps to vmkernel opID d8####5e
    2025-09-27T06:24:09.088Z cpu60:2103476 opID=d8df505e)nsx_vdrb: VdrPortsetPropSet:4##: [nsx@6876 comp="nsx-esx" subcomp="vdrb-19####61"]SYS:Set VDS portset property [com.vmware.nsx.vdr.dvptracking] on VDS [DvsPortset-#]
    ...
    2025-09-27T06:24:10.845Z cpu99:118223412)nsx_vdrb: VdrUpdateTeaming:2##3: [nsx@6876 comp="nsx-esx" subcomp="vdrb-19801961"]CNXN:[C:<Teaming_policy>,P:16#####10] Update Teaming Information
    2025-09-27T06:24:10.845Z cpu99:118223412)nsx_vdrb: VdrUpdateTeaming:2##3: [nsx@6876 comp="nsx-esx" subcomp="vdrb-19801961"]CNXN:[C:<Teaming_policy>,P:13#####79] Update Teaming Information
    2025-09-27T06:24:13.923Z cpu79:2103476 opID=6a####29)World: 1####7: VC opID sps-Main-99####-###-####53-a#-a#-c##4 maps to vmkernel opID 6a####29
    ...
    2025-09-27T06:24:19.099Z cpu12:2097276)Vmxnet3: 2###0: Tx completion timeout exceeded for tq 0 port a0####b
    2025-09-27T06:24:19.099Z cpu12:2097276)Vmxnet3: 2###1: <VM_NAME>.eth<numb>,00:50:5#:##:##:de, portID(16#####31): Hang detected,numHangQ: 1 enableGen: 6626
    2025-09-27T06:24:19.099Z cpu12:2097276)Vmxnet3: 2###8: portID:16#####31, qid: 0, next2TX: 77, next2Comp: 78,next2Write:506, ringSize: 512 inFlight: 1, delay(ms): 8106,  txStopped: 0
    2025-09-27T06:24:19.099Z cpu12:2097276)Vmxnet3: 2###1: portID: 16#####31, sop: 78 eop: 78 enableGen: 6626 qid: 0, pkt: 0x45########00

Environment

VMware NSX-T Data Center 3.2.1 and earlier

Cause

Packet is leaked due to a race condition during VDR connection message processing.

Resolution

Issue is fixed in VMWare NSX Version 4.0.1.1 and later

VMware NSX 4.0.1.1 Release Notes
Fixed Issue 3023598: When Virtual Distributed Router (VDR) connect info is updated, some packets routed by VDR might be leaked.
The impacted VM might fail to send out packets.



Additional Information