VMware vSphere ESXi
When a VM moves to a new host, the physical switch port connected to the destination host must learn the VM's MAC address to update its forwarding table (MAC table). This is typically triggered by a Reverse ARP (RARP) packet sent by the ESXi host on behalf of the VM.
The connectivity failure occurs when:
The RARP packet or subsequent ARP requests from the VM are disregarded or dropped by the physical network infrastructure.
There is a delayed MAC table update on the physical switches.
Since packet captures confirm that the ESXi host is correctly egressing the RARP and ARP packets, the issue resides within the physical network fabric.
This needs to be further investigated by the physical networking team to check on delayed MAC learning.
Refer to KB to know more about IP to MAC mapping, GARP, RARP and Notify Switch setting for Virtual Machine Connectivity
For related information, check below KBs:
Troubleshooting when a virtual machine loses network connection after vMotion