HCX vMotion migration failed with error Connection closed by remote host

Products

• VMware HCX

Issue/Introduction

• HCX Replication Assisted vMotion (RAV) or vMotion are failing with the following error(/common/logs/admin/app.log):
  

  Migration to host <#.#.#.#> failed with error Connection closed by remote host, possibly due to timeout (#######). <timestamps> vMotion
  migration [##############################################) failed to receive 68/68 bytes from the remote host <#.#.#.#>: 
  Connection closed by remote host, possibly due to timeout vMotion migration [#############################] failed to send init message to the remote host <#.#.#.#>

• From the vCenter log bundle (/commands/journalctl_-b--0.txt), a warning indicates a duplicate IP address, which is the same IP displayed in the HCX Manager UI error.
  

  <timestamps> vpxd[###]: Event [#] [1-1] [<timestamps>] [vim.event.EventEx] [info] [] [####] [###] [A duplicate IP address was detected for #.#.#.# on the interface vmk1. The current owner is ##:##:##:##:##:##.]

• IP range used for the HCX vMotion network profile is overlapping with the IP used in ESXi hosts for vMotion.
• Diagnostic report run on the service mesh reports a connectivity issue between the IX vmotion IP and ESXi host vMotion IP. However manual connection tests such as Ping and port connectivity tests complete successfully.
  

Environment

VMware HCX

Cause

HCX vMotion task is failing due to a duplicate IP assigned to both the ESXi VMkernel interface (vMotion) and IX vMotion interface.

Resolution

1. Reassigning a different IP address to the VMkernel interface on the ESXi host, ensuring it does not use the same IP as the HCX Mobility Host.
   
   OR
   
   
2. Reassign a new IP to the IX/Mobility Host vSphere Agent:
   a) Disable the migrations services from the Service Mesh.
   
   Note: Do not remove the Network Extension option only.
   This action will remove the Mobility Host, allowing you to remove the duplicate IP from the network profile.
   
   b) Next, update the network profile for vMotion and remove the duplicate IP.
   c) Enable all the services again.

Additional Information

Troubleshooting HCX Migrations Failures
Migration switchover failed with the error "Relocate task failed"