NSX Manager UI displays notification "Failed to fetch System details. Please contact the administrator. Error: null (Error code: 513002)"

Products

• VMware NSX

Issue/Introduction

• The NSX Manager UI displays the following error and/or the notification "Failed to fetch System details. Please contact the administrator. Error: null (Error code: 513002)". 

• From var/log/syslog:

we can note that Operation:'GET@/api/v1/ui-controller/fabric-aggregate-status' Operation status: failed 

<TIMESTAMP> XXXXXXXXXXXX NSX 4563 - [nsx@6876 comp="nsx-manager" level="INFO" subcomp="manager"] readFabricAggregateStatus TZes spent 41ms
<TIMESTAMP> XXXXXXXXXXXX NSX 4563 - [nsx@6876 comp="nsx-manager" level="INFO" reqId="<UUID>" subcomp="manager" username="admin"] getNodesCountInfo starts
<TIMESTAMP> XXXXXXXXXXXX NSX 4563 - [nsx@6876 audit="true" comp="nsx-manager" level="INFO" reqId="<UUID>" subcomp="manager"] UserName="admin", ModuleName="NsxHome", Operation="ReadFabricAggregateStatus", Operation status="failure"
<TIMESTAMP> XXXXXXXXXXXX NSX 4563 SYSTEM [nsx@6876 comp="nsx-manager" errorCode="MP100" level="ERROR" subcomp="manager"]
<TIMESTAMP> XXXXXXXXXXXX NSX 4563 SYSTEM [nsx@6876 audit="true" comp="nsx-manager" level="INFO" subcomp="manager"] UserName:'admin' ModuleName:'common-services' Operation:'GET@/api/v1/ui-controller/fabric-aggregate-status' Operation status: 'failure' Error: General error has occurred.
<TIMESTAMP> XXXXXXXXXXXX NSX 4563 - [nsx@6876 comp="nsx-manager" errorCode="PM513002" level="ERROR" reqId="<UUID>" subcomp="manager" username="admin"] REST API failed: http://127.0.0.1:7440/nsxapi/api/v1/ui-controller/fabric-aggregate-status GET
<TIMESTAMP> XXXXXXXXXXXX  NSX 4563 - [nsx@6876 comp="nsx-manager" errorCode="PM513002" level="ERROR" reqId="<UUID>" subcomp="manager" username="admin"] Cannot fetch system details: Failed to fetch System details. Please contact the administrator. Error: 500 : "{<EOL>    "module_name" : "common-services",<EOL>    "error_message" : "General error has occurred.",<EOL>    "details" : "java.lang.NullPointerException",<EOL>    "error_code" : 100<EOL>}<EOL>"
<TIMESTAMP> XXXXXXXXXXXX  NSX 4563 - [nsx@6876 audit="true" comp="nsx-manager" level="INFO" reqId="<UUID>" subcomp="manager" username="admin"] UserName="admin", ModuleName="NsxHome", Operation="ReadSystemAggregateStatus", Operation status="failure"
<TIMESTAMP> XXXXXXXXXXXX NSX 4563 SYSTEM [nsx@6876 audit="true" comp="nsx-manager" level="INFO" subcomp="manager"] UserName:'admin' ModuleName:'Policy' Operation:'GET@/api/v1/ui-controller/system-aggregate-status' Operation status: 'failure' Error: Failed to fetch System details. Please contact the administrator. Error: 500 : "{<EOL>    "module_name" : "common-services",<EOL>    "error_message" : "General error has occurred.",<EOL>    "details" : "java.lang.NullPointerException",<EOL>    "error_code" : 100<EOL>}<EOL>"
<TIMESTAMP> XXXXXXXXXXXX NSX 4563 - [nsx@6876 audit="true" comp="nsx-manager" level="INFO" reqId="<UUID>" subcomp="manager"] UserName="admin", ModuleName="NsxHome", Operation="ReadInventoryAggregateStatus", Operation status="success"
<TIMESTAMP> XXXXXXXXXXXX NSX 1730 - [nsx@6876 comp="nsx-manager" subcomp="appl-proxy" tid="1730" level="INFO"] TnConnMgr: OnServerConnectionUpDown: ConnInfo:{id: <ID>, pr: normal, net: {id: <ID>, pr: normal, side: server, endpoint: unix:///var/run/vmware/appl-proxy/aph.sock, local-ep: unix:///var/run/vmware/appl-proxy/aph.sock, peer-ep: unix:///var/run/vmware/appl-proxy/aph.sock(pid:1551 uid:33 gid:33), peer-auth: {certificate: none}}} Status:Down

 

• The below GET API returns "java.lang.NullPointerException"

GET https://<NSX-Manager-IP>/api/v1/ui-controller/fabric-aggregate-status

{

    "module_name": "common-services",

    "error_message": "General error has occurred.",

    "details": "java.lang.NullPointerException",

    "error_code": 100

}

 

• Debug level logging is enabled for the manager , can be verified as below :

  nsxmanager > get service manager

  Service name:                        manager

  Service state:                       running

  Logging level:                       debug

 

Environment

VMware NSX

Cause

Aggregation API /api/v1/ui-controller/system-aggregate-status throws a NullPointerException when attempting to retrieve host transport nodes counts as part of the NSX Home dashboard.
This occurs due to a defect where DEBUG level log attempts to access an empty/null object under the below conditions:

Conditions: 
1.Host is  not prepared as nsx-t transport node.
2 Debug logging is enabled for service manager or a sub-service under it.

Resolution

Workaround:

1. disable the "DEBUG" log level. 
manager> set service manager logging-level info
or 
2. Disable it only for the affected package:
manager> set service manager logging-level info package com.vmware.nsx.management.inventory.finder

Permanent Fix:
The fix is available in NSX 4.1.1 and later releases.