Failed to install software on host. Failed to install software on host. <hostname> : java.rmi.RemoteException: VI SDK invoke exception:java.rmi.RemoteException: VI SDK invoke exception:org.dom4j.DocumentException: Error on line 1 of document : Content is

Products

• VMware NSX

Issue/Introduction

• ESXi host is prepared as a Transport Node in VMware NSX.
• Some of the host transport nodes are in a "Failed" state in NSX UI. 
• Error on the host is:
  "Failed to install software on host. Failed to install software on host. <hostname> : java.rmi.RemoteException: VI SDK invoke exception:java.rmi.RemoteException: VI SDK invoke exception:org.dom4j.DocumentException: Error on line 1 of document : Content is not allowed in prolog."

Environment

VMware NSX

Resolution

Before attempting to resolve this issue, please ensure the host's ramdisk is not full.
ref. KB articles: Identifying and Resolving Full Ramdisk Issues in ESXi Environments and ESXi host RAM disk is full.
A preferred way to free up the ramdisk is reboot of the impacted ESXi host. 

To resolve this issue, you can use the "Resolve" button in NSX UI:

1. In NSX UI, browse to System -> Fabric -> Hosts.
2. On the host in question, click on the status of the host, this is typically "Failed", or "Install Failed".
3. Click on the error to reveal the error message.
4. Set the tick box next to the error.
5. Click on "RESOLVE" button to trigger the internal resolver workflow.

If this doesn't resolve the issue, please follow the steps below:

1. In NSX UI (System -> Fabric -> Hosts), use the check box to select the host in question.
2. Use the "Install NSX" button on the top of host list. 
3. Don't make any changes to the configuration of the host, and click through the wizard to finish the installation.
4. NSX Manager will synchronize with the host, and rectify any inconsistencies. 

If the above doesn't fix the issue, please open a support case with Broadcom Support and refer to this KB article.
For more information, see Creating and managing Broadcom support cases.

Additional Information

If you are contacting Broadcom support about this issue, please provide the following:

• NSX Manager support bundles.
• ESXi host support bundles for hosts that are failing to configure as transport nodes.
• Text of any error messages seen in NSX GUI or command lines pertinent to the investigation.
  This can be either a screenshot, or copy/paste of the error in plain text.

Handling Log Bundles for offline review with Broadcom support:

• Collect Support Bundles for Troubleshooting VMware NSX
• Uploading files to cases on the Broadcom Support Portal
• Creating and managing Broadcom support cases