NSX Upgrade in SDDC Manager Upgrade fails due to VxRail API Timeout Issue

Products

• VMware SDDC Manager

Issue/Introduction

• NSX Upgrade failing on SDDC Manager after 20 mins or a short period of time 
• /var/log/vmware/vcf/lcm/lcm-debug.log or /var/log/vmware/vcf/lcm.log has the following entries: 

2024-07-10T18:21:16.260+0000 INFO 
[vcf_lcm,0000000000000000,0000,upgradeId=779f4111-17ff-474e-b9be-1a65993f3862,resourceType=NSX_T_PARALLEL_CLUSTER,resourceId=<nsx_fqdn>:_ParallelClusterUpgradeElement,bundleElementId=584a01af-4c29-4f14-b471-5d536aac80cb]
[o.a.h.c.h.i.c.HttpRequestRetryExec,Upgrade-7] Recoverable I/O exception
(java.net.SocketTimeoutException) caught when processing request to
{s}->https://<vxrail_manager_fqdn>:443

2024-07-26T17:50:18.348+0000 ERROR [vcf_lcm,0000000000000000,0000,upgradeId=50608607-9176-493f-8e3c-2af12a9d6803,resourceType=NSX_T_PARALLEL_CLUSTER,resourceId=<nsx_fqdn>:_ParallelClusterUpgradeElement,bundleElementId=584a01af-4c29-4f14-b471-5d536aac80cb] [c.v.e.s.l.p.i.nsxt.NsxtUpgradeUtil,Upgrade-16] Unhandled exception during NSX component upgrade:
java.net.SocketTimeoutException: Read timed out
        at java.base/sun.nio.ch.NioSocketImpl.timedRead(NioSocketImpl.java:283)
        at java.base/sun.nio.ch.NioSocketImpl.implRead(NioSocketImpl.java:309)
        at java.base/sun.nio.ch.NioSocketImpl.read(NioSocketImpl.java:350)
        at java.base/sun.nio.ch.NioSocketImpl$1.read(NioSocketImpl.java:803)
        at java.base/java.net.Socket$SocketInputStream.read(Socket.java:966)

 

 

Cause

VxRail system info API takes too long to respond

 

Resolution

1. Run the following command on SDDC Manger to test the time for the VxRail system info API to respond: 

time curl -k --user "[email protected]:<password>" \
  --request GET "https://<VxRail_IP_address>/rest/vxm/v1/system"

2. If the above output shows more than 2 minutes to run the API, engage Dell to resolve issue with VxRail Manager(s). Response in the logs should return HTTP Status 200 - OK