Packet loss is noticed for packets destined to an NSX edge uplink (switchport). A pktcap-uw --trace shows packet drops at VDL2UplinkInput IO Chain:
The edge and host TEPs are in the same VLAN and the edge nodes are connected to a DvPG on a VDS used by NSX, on an ESXi host prepared for NSX. This behavior is expected, refer to https://knowledge.broadcom.com/external/article/317168 for more details.
Use an NSX VLAN-backed segment (trunk) instead of a DvPG to circumvent this limitation.