Transport Node Status is INSTALL FAILED when "localcli software vib list" response is slow

Products

• VMware NSX

Issue/Introduction

• Transport Node Status is INSTALL FAILED on UI (System > Fabric > Host).
• nsxapi.log shows logs below:
  <TIMESTAMP> ERROR http-nio-127.0.0.1-7440-exec-# SFHCServiceImpl 27782 FABRIC [nsx@6876 comp="nsx-manager" errorCode="MP26032" level="ERROR" reqId="<UUID>" subcomp="manager" username="admin"] Failed to get SFHC response. MessageType MT_SOFTWARE_STATUS, operation <UUID>, clientId <Client_UUID>
• nsx-syslog.log on the ESXi host says:
  <TIMESTAMP> nsx-sfhc[<PID>]: NSX <NUMBER> - [nsx@<NUMBER> comp="nsx-esx" subcomp="nsxsfhc" tid="<TID>" level="INFO"] GetAllSoftwares execution time: 110.000000 seconds
• localcli software vib list response is slow.
• SFHC response timeout value is changed in 4.0.1.
  • For 4.0.1 or later, timeout is 40 seconds.
  • For 3.x, timeout is 17 seconds.

Environment

VMware NSX 4.x

VMware NSX-T Data Center 3.x

Cause

NSX Manager verifies NSX VIBs are installed on the transport node by running localcli software vib list.
Since localcli software vib list takes long time, NSX Manager fails to verify install status and marks as INSTALL FAILED.

Resolution

Currently, there is no resolution.

Contact Broadcom Support to investigate further.