Unable to see NSX Manager in Networking & Security and unable to open NSX Web UI

Products

• VMware NSX

Issue/Introduction

Symptoms:

• Unable to see NSX Manager in Networking & Security.
• vCenter /var/log/vmware/vsphere-client/logs/vsphere_client_virgo.log shows following messages:

[2019-08-21T11:25:45.358+01:00] [WARN ] pool-1693-thread-1 com.vmware.vshield.plugin.common.util.CommonUtil Authentication is failed for given NSX Manager.
[2019-08-21T11:25:45.358+01:00] [WARN ] pool-1693-thread-1 com.vmware.vshield.plugin.common.util.CommonUtil NSX Manager IpAddress: ##.##.##.##
[2019-08-21T11:25:45.358+01:00] [WARN ] pool-1693-thread-1 com.vmware.vshield.plugin.common.util.CommonUtil VC IpAddress: https://vcenter:443/sdk
[2019-08-21T11:25:45.358+01:00] [WARN ] pool-1693-thread-1 com.vmware.vshield.plugin.common.util.CommonUtil VC UUID: d4a25388-####-####-####-############
[2019-08-21T11:25:45.358+01:00] [WARN ] pool-1693-thread-1 com.vmware.vshield.plugin.common.util.CommonUtil Version: 6.4.5.13282012
[2019-08-21T11:25:45.358+01:00] [WARN ] pool-1693-thread-1 com.vmware.vshield.plugin.common.util.CommonUtil NSX server(##.##.##.##) is not authenticated for current user:
[2019-08-21T11:25:45.358+01:00] [WARN ] pool-1693-thread-1 com.vmware.vshield.plugin.common.util.CommonUtil Error occured while authentication: org.springframework.remoting.RemoteConnectFailureException: Could not connect to HTTP invoker remote service at [https://##.##.##.##/remote/api/UserMgmtFacade]; nested exception is org.apache.http.conn.HttpHostConnectException: Connect to ##.##.##.##:443 [/##.##.##.##] failed: Connection refused (Connection refused)

• Unable to open NSX Web UI https://<nsx_manager_ip> - Refused to connect
• Can SSH to NSX Manager.
• Restarting NSX Manager fixes the issue temporarily, but it comes back again.

Environment

NSX for vSphere 6.3.6

Cause

An intermittent storage issue can cause the app-mgmt service to stop spontaneously. It does not start back until manually started, or when you reboot the NSX Manager.

 

 

Impact/Risks

While app-mgmt service is stopped, you will not be able to view the NSX Manager in Networking & Security, and you will not be able to open the NSX Manager Web UI as well.

Resolution

Issue is resolved in NSX for vSphere 6.4.6

 

Workaround

Reboot NSX Manager. This fixes the issue temporarily, but it comes back if a similar storage issue occurs again.

Additional Information

If unable to access NSX-V manager please look at the vmkernel.log and vobd.log located on the same ESXi host as NSX-V manager during the issue for an alternative option. This will also show the APD on the datastore where the NSX-V Manager VM is located.

Log location = /var/run/log/vmkernel.log and /var/run/log/vobd.log