vm/vmknic traffic disconnects on software vlan untagging mode.
The issue happens only with Broadcom BCM5741x NIC.
There is an issue with the firmware programming of the CFA table entries when an interface is put in promiscuous mode. This is causing the tagged ucast traffic to get dropped.
To workaround the issue, please change software tagging as OFF, then again set it to ON.
esxcli network nic software set --untagging=0 -n vmnicN
esxcli network nic software set --untagging=1 -n vmnicN