NSX Manager UI reports "Error: Search Index is out of sync for 'Host Transport Node'"(Error code: 60516)

Products

• VMware NSX

Issue/Introduction

• In VMware NSX, after performing host transport node deletion or decommissioning, upon navigating to Fabric>Hosts, the following error is observed: 

"Error: Search Index is out of sync for 'Host Transport Node'. Run the 'start search resync all' CLI command on the NSX appliance to resync. If the issue persists, contact VMware Support."(Error code: 60516)

• No Clusters or Standalone hosts can be viewed on the UI due to this issue.

Environment

VMware NSX

Cause

The issue occurs due to mismatch in the search index used by NSX Manager for the specific Host Transport Node.

Resolution

• Run the command start search resync all on every manager node.
• Once the Fabric > Hosts view is up, check if any decommissioned hosts are still showing up on NSX Manager. If yes, run the following API call to delete the decommissioned hosts from NSX Manager.  

DELETE https://<NSX Mgr IP>/policy/api/v1/infra/sites/default/enforcement-points/default/host-transport-nodes/<UUID>?force=true&unprepare_host=false

•  If the issue still persists, contact Broadcom Support: Contact Broadcom support

Additional Information

NSX Manager alarm "Search index is out of sync for 'Alarm'" (Error code: 60516)