"I/O error on POST request for "https://<vcenter_fqdn>:9087/vum-fileupload/login" when upgrading or installing NSX on a vLCM prepared cluster

Products

• VMware NSX

Issue/Introduction

• When installing or upgrading NSX on a cluster which uses vLCM, the following ERROR is displayed on the UI:
  
  Upload NSX-LCP bundle operation failed: org.springframework.web.client.ResourceAccessException: I/O error on POST request for "https://<vcenter_fqdn>:9087/vum-fileupload/login": Connect to <vcenter_fqdn>:9087 [<vcenter_fqdn>/<vcenter_ip>] failed: Connection timed out (Connection timed out); nested exception is org.apache.http.conn.HttpHostConnectException: Connect to <vcenter_fqdn>:9087 [<vcenter_fqdn>/<vcenter_ip>] failed: Connection timed out (Connection timed out)

• If you try to resolve the issue on the popup menu, the following ERROR is displayed:
  
  Pushing NSX depot(s) on Compute Manager: ########-####-####-####-############ failed with error: Error while logging into VCorg.springframework.web.client.ResourceAccessException: I/O error on POST request for "https://<vcenter_ip>:9087/vum-fileupload/login": Connect to <vcenter_ip>:9087 [<vcenter_ip>/#.#.#.#] failed: Connection timed out (Connection timed out); nested exception is org.apache.http.conn.HttpHostConnectException: Connect to <vcenter_ip>:9087 [<vcenter_ip>/#.#.#.#] failed: Connection timed out (Connection timed out). Retry Transport Node Collection at cluster

Cause

When NSX cluster has vLCM enabled, NSX Manager uses TCP port 9087 to push NSX Depot(s) to vLCM component on vCenter. If TCP port 9087 is blocked on the firewall from NSX Manager to vCenter, the upgrade or install fails while attempting to push the NSX depot(s) to the Compute Manager.

Resolution

Ensure that TCP port 9087 is open between the NSX Managers and the vCenter Server.

You can use netcat (nc) to confirm connectivity to the TCP port 9087 from the NSX Manager(s) to the vCenter server: 

1. Open SSH to NSX Manager and log in using root account
2. run the following command to check the connectivity on TCP port 9087:
   #nc -zv <vCenter-FQDN> 9087
3. Example response when connection succeeded:
   Connection to <vCenter-FQDN> 9087 port [tcp/*] succeeded!
4. If the connection is not succeeded, then investigate with your firewall team where the port may be blocked.
5. Check the connection from all three NSX Managers.

 

Additional Information

Note: This port is included in the VMware Ports and Protocols documentation for NSX: VMware Ports and Protocols