NSX installation fails on the ESXi Host with an error "Failed to install software on host. Error occurred"

Products

• VMware NSX

Issue/Introduction

• ESXi Host was moved into the ESXi Host Cluster with NSX TNP assigned to it.
• NSX installation on the ESXi Host Fails with Error "Failed to install software on host. Error occurred"
  
• Below error messages are see in /var/log/proton/nsxapi.log the NSX Managers.
  WARN http-nio-127.0.0.1-7440-exec-4134 HeartbeatHelper 77702 SYSTEM [nsx@6876 comp="nsx-manager" level="WARNING" reqId="da######-####-####-####-##########d9" subcomp="manager" username="svc_skybox_nsxaudit"] getClientHeartbeatStatus: client d4######-####-####-####-##########a0, no record for heartbeat found.
INFO http-nio-127.0.0.1-7440-exec-4134 IssueManagerImpl 77702 FABRIC [nsx@6876 comp="nsx-manager" level="INFO" reqId="da######-####-####-####-##########d9" subcomp="manager" username="svc skybox nsxaudit"] Invoking issue finder com. vmware.nsx.management.service_fabric. issue.UninstallFailed@4057ead2 on d4######-####-####-####-##########a0
WARN http-nio-127.0.0.1-7440-exec-4134 HeartbeatHelper 77702 SYSTEM [nsx@6876 comp="nsx-manager" level="WARNING" reqId="da######-####-####-####-##########d9" subcomp="manager"username="svc skybox nsxaudit"] getClientHeartbeatStatus: client d4######-####-####-####-##########a0, no record for heartbeat found.
INFO http-nio-127.0.0.1-7440-exec-4134 UninstallFailed 77702 FABRIC [nsx@6876 comp="nsx-manager" level="INFO" reqId="da######-####-####-####-##########d9" subcomp="manager" username="svc_skybox_nsxaudit"] Got deployment status INSTALL FAILED for node d4######-####-####-####-##########a0
WARN http-nio-127.0.0.1-7440-exec-4134 HeartbeatHelper 77702 SYSTEM [nsx@6876 comp="nsx-manager" level="WARNING" reqId="da######-####-####-####-##########d9" subcomp="manager" username="svc_skybox_nsxaudit"] getClientHeartbeatStatus: client d4######-####-####-####-##########a0, no record for no record for heartbeat found.
INFO http-nio-127.0.0.1-7440-exec-4134 InstallFailed 77702 FABRIC [nsx@6876 comp="nsx-manager" level="INFO" reqId="da######-####-####-####-##########d9" subcomp="manager" username="svc_skybox_nsxaudit"] Got deployment status INSTALL FAILED for node d4######-####-####-####-##########a0
INFO http-nio-127.0.0.1-7440-exec-4134 InstallFailed 77702 FABRIC [nsx@6876 comp="nsx-manager" level="INFO" reqId="da######-####-####-####-##########d9"  subcomp="manager" username="svc_skybox_nsxaudit"] Issue INSTALL FAILED observed for node : d4######-####-####-####-##########a0. Msg : Failed to install software on host. Error occurred
  
  Note: The preceding log excerpts are only examples. Date, time, and environmental variables may vary depending on your environment.

Environment

VMware NSX 4.2.x

Cause

Heartbeat communication issue between the NSX Manager and the ESXi Host Transport Nodes. The NSX Managers are affected by issue as described in the KB FIPS validation fails causing NSX Manager unavailability

Resolution

The FIPS Validation issue on the NSX Manager is resolved in VMware NSX version 4.2.3.3. available at Broadcom downloads. If having difficulty finding and downloading software, please review the Download Broadcom products and software KB

If you have already encountered the issue and are unable Install NSX on the ESXi Host then follow the workaround of performing rolling reboot of the NSX Manager to fix the Heartbeat communication issue between the NSX Manager and the ESXi Host Transport Nodes