Enhanced replication fails with "A replication error occurred at the vSphere Replication Server for replication 'xxx'. Details: 'No connection to VR Server for virtual machine xxx on host cap1mspesx3.local in cluster xx_xx in xxxxx: Unknown'"

Products

• VMware Live Recovery

Issue/Introduction

Symptoms:

Error - Fault occurred while performing health check. Details: 'Connect: Input/output error'.

 

Environment

VMware vSphere Replication 8.x

VMware vSphere Replication 9.x

Cause

Found error in below logs,
 hbr-agent.log (of source host XXXXXESX4.local) reports Input/output error to all the Target ESXi VMkernel adapters (on which vSphere Replication Traffic is enabled):

2025-01-23T08:05:18.907Z In(166) hbr-agent-bin[2172222]: [0x000000e886f80700] error: [Proxy [Group: GID-xxxxxxx-a742-xxxx-8f01-xxxxxxxa3a8b] -> [xx.xx.xx.x6:32032]] Failed to connect to server xx.xx.xx.x6:32032 using broker info: Input/output error
2025-01-23T08:05:18.908Z In(166) hbr-agent-bin[2172222]: [0x000000e886cf1700] info: [Proxy [Group: GID-xxxxxxx-a742-xxxx-8f01-xxxxxxxa3a8b] -> [xx.xx.xx.x6:32032]] Setting up secure tunnel to brokered server xx.xx.xx.x6:32032 (2 of 2)
2025-01-23T08:05:18.908Z In(166) hbr-agent-bin[2172222]: [0x000000e886cf1700] info: [Proxy [Group: GID-xxxxxxx-a742-xxxx-8f01-xxxxxxxa3a8b] -> [xx.xx.xx.x2:32032]] Bound to vmk: vmkxx for connection to xx.xx.xx.x6:32032
2025-01-23T08:06:06.036Z In(166) hbr-agent-bin[2172222]: [0x000000e886f80700] error: [Proxy [Group: GID-xxxxxxx-a742-xxxx-8f01-xxxxxxxa3a8b] -> [xx.xx.xx.x3:32032]] Failed to connect to xx.xx.xx.x3:32032. Using nic 'vmkxx'. Error: Connection timed out
2025-01-23T08:06:06.036Z In(166) hbr-agent-bin[2172222]: [0x000000e886f80700] error: [Proxy [Group: GID-xxxxxxx-a742-xxxx-8f01-xxxxxxxa3a8b] -> [xx.xx.xx.x3:32032]] Failed to bind to any of the specified VMKs for connection to xx.xx.xx.x3:32032
2025-01-23T08:06:06.036Z In(166) hbr-agent-bin[2172222]: [0x000000e886f80700] error: [Proxy [Group: GID-xxxxxxx-a742-xxxx-8f01-xxxxxxxa3a8b] -> [xx.xx.xx.x3:32032]] Failed to connect to server xx.xx.xx.x3:32032 using broker info: Input/output error
2025-01-23T08:06:06.037Z In(166) hbr-agent-bin[2172222]: [0x000000e886f80700] error: [Proxy [Group: GID-xxxxxxx-a742-xxxx-8f01-xxxxxxxa3a8b] -> [xx.xx.xx.x3:32032]] Exhausted all server endpoints reported by broker.
2025-01-23T08:06:33.916Z In(166) hbr-agent-bin[2172222]: [0x000000e886d72700] error: [Proxy [Group: GID-xxxxxxx-a742-xxxx-8f01-xxxxxxxa3a8b] -> [xx.xx.xx.x2:32032]] Failed to connect to xx.xx.xx.x2:32032. Using nic 'vmkxx'. Error: Connection timed out
2025-01-23T08:06:33.916Z In(166) hbr-agent-bin[2172222]: [0x000000e886d72700] error: [Proxy [Group: GID-xxxxxxx-a742-xxxx-8f01-xxxxxxxa3a8b] -> [xx.xx.xx.x2:32032]] Failed to bind to any of the specified VMKs for connection to xx.xx.xx.x2:32032
2025-01-23T08:06:33.916Z In(166) hbr-agent-bin[2172222]: [0x000000e886d72700] error: [Proxy [Group: GID-xxxxxxx-a742-xxxx-8f01-xxxxxxxa3a8b] -> [xx.xx.xx.x2:32032]] Failed to connect to server xx.xx.xx.x2:32032 using broker info: Input/output error

As per the error 32032 port connection fails between source to target host. connection fails.

Resolution

Performed below steps and traceroute from source to target destination,

1. Identified the management adapter(vmk0) and Replication adapter(vmkxx) and services enabled.

2. The replication is isolated with adapter vmkxx

3. Changed the services on vmkxx with vSphere replication and vSphere replication NFC.

4. The same has been disabled on management adapter.

5. This resolved the issue of port connection on 32032.

Replication to be Re-configured with Enhanced Replication Mode.