http://127.0.0.1:9286/sdk invocation failed with "java.net.SocketTimeoutException: 30,000 milliseconds timeout

Products

VMware Live Recovery VMware Site Recovery Manager 8.x

Issue/Introduction

Symptoms:

SRM reconfiguration keeps failing, After Upgrade.
Network connectivity between the vCenter server and Site Recovery Manager are open.
All the required ports are open

Steps to validate:

/var/log/vmware/drconfigui/drconfig.log shows:

com.vmware.vim.vmomi.client.exception.ConnectionException: http://127.0.0.1:9286/sdk invocation failed with "java.net.SocketTimeoutException: 30,000 milliseconds timeout on connection http-outgoing-14 [ACTIVE]"
at com.vmware.vim.vmomi.client.common.impl.ResponseImpl.setError(ResponseImpl.java:261)
at com.vmware.vim.vmomi.client.http.impl.HttpExchangeBase.setResponseError(HttpExchangeBase.java:321)
at com.vmware.vim.vmomi.client.http.impl.HttpAsyncExchange$1$1.invokeWithinScope(HttpAsyncExchange.java:131)
at com.vmware.vim.vmomi.client.http.impl.TracingScopedRunnable.run(TracingScopedRunnable.java:24)
at com.vmware.dr.ui.tools.utilities.ThreadContext.lambda$wrap$10(ThreadContext.java:55)
at com.vmware.dr.ui.tools.utilities.ThreadContext.execute(ThreadContext.java:209)
at com.vmware.dr.ui.tools.utilities.ThreadContext.execute(ThreadContext.java:185)
at com.vmware.dr.ui.tools.utilities.ThreadContext.setupContext(ThreadContext.java:76)
at com.vmware.dr.ui.tools.utilities.ThreadContext.setupContext(ThreadContext.java:105)
at com.vmware.dr.ui.tools.utilities.ExecutorUtils.lambda$wrap$6(ExecutorUtils.java:36)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.net.SocketTimeoutException: 30,000 milliseconds timeout on connection http-outgoing-14 [ACTIVE]

Environment

VMware Site Recovery Manager 8.x

VMware Live Site Recovery

Cause

The issue occurs due to the extended time required to resolve the VC FQDN.

/var/log/vmware/drconfigui/drconfig.log:

2025-02-18T20:02:52.180Z verbose drconfig[00774] [SRM@6876 sub=Default.SiteConnections opID=bd06a10d-bf5c-4193-81ab-8da29cd4509d-isReconfigureRequired] SiteConnections created for 'https://1
72.x.x.22:443/lookupservice/sdk' with thumbprint 'xx:xx:xx:xx:xx:xx:xx:xx:xx:xx:xx:xx:xx:xx:xx:DE:B4:77:AA:72:94:B9:1D:C5:19:54:78:55:96:FF:A1:FB'
2023-01-27T20:02:52.184Z verbose drconfig[00774] [SRM@6876 sub=vmomi.soapStub[12] opID=bd06a10d-bf5c-4193-81ab-8da29cd4509d-isReconfigureRequired] Connected to host using internallookup/2.0 (lookup. version. version2)
2025-02-18T20:03:13.780Z warning drconfig[01363] [SRM@6876 sub=Default] Failed to connect socket; , <TCP '172.x.x.22 : 443'>>, e: 110(Connection timed out)
2025-02-18T20:03:13.780Z verbose drconfig[01362] [SRM@6876 sub=vmomi.soapStub[11] opID=8f3c8409-f5b3-4096-9a87-2f6eab6999d2-isReconfigureRequired] Resetting stub adapter for server: Closed
2025-02-18T20:03:13.780Z error drconfig[01362] [SRM@6876 sub=DrConfigConfigurationManager opID=8f3c8409-f5b3-4096-9a87-2f6eab6999d2-isReconfigureRequired] Failed to obtain VC instance id by URL.

Resolution

The issue should be resolved by the administrators in charge of DNS servers or Domain Controllers

Workaround

To work around this issue, add the vCenter, SRM and VRMS IP and FQDN for both paired sites in the /etc/hosts file on both SRM, vCenter and VR appliances.
To add the vCenter IP and FQDN:

Log in to Site Recovery Manager Appliance console.
Run these commands:

cd /etc
cp hosts hosts.bak (to create back for host file)
vi hosts
Enter I key to enable insert mode.
Move the cursor, create an entry for vCenter, SRM and VRMS IP and FQDN for both sites below the local host entry.

Example of host's file:

# VAMI_EDIT_BEGIN
127.x.x.x localhost
192.xxx.x.xx srmr-a.example.local srmr-a
# VAMI_EDIT_END
Add the vCenter IP and FQDN after Site Recovery manager Appliance IP and FQDN.

Example of hosts file after the change:

# VAMI_EDIT_BEGIN
127.x.x.x localhost
192.168.x.xx srmr-a.example.local srmr-a
192.167.x.xx vcprod.example.local vcprod
192.166.x.xx vr.example.local vr
# VAMI_EDIT_END
Refresh the SRM DR UI page/Reconnect the Pair.