"Failed to get "INVENTORY OVERVIEW" report (Error code: 513002)" on inventory page and "Search index out of sync for 'Group' (Error code: 60516)' on Groups page in local manger for Federated NSX Environment

Products

• VMware NSX

Issue/Introduction

• NSX is in Federated environment with one Global Manager and two Local Manager sites.
• Inventory overview fails to load with error:  Failed to get "INVENTORY OVERVIEW" report - Index out of sync. Please perform a re-sync.:
  
• The Inventory > Groups page shows no groups and displays an error stating Search index is out of sync for 'Group'.
  
• The Alarms page shows no alarms, only a spinning circle.
  
• On the System > Appliances page, the appliances have a status of Degraded.
• No issues in the UI on the Global Manager
• No issues are seen in the UI on the other Local Manager site, only on one local manager.
• You see the following error in /var/log/proton/nsxapi.log and/or /var/log/search-manager/search-manager.log of the affected Local Manager: 
  

  <Timestamp> ERROR UfoIndexer-BatchExecutor-search_policy-4 UfoGenericConverter 10359 - [nsx@6876 comp="nsx-manager" errorCode="MP60511" level="ERROR" subcomp="manager"] [Indexing: DtoConversion] Could not convert UFO object to Dto by DTO converter UfoObject{operationType=CREATE, descriptor=IndexingTypeDescriptor{tableName='Group', streamTag=POLICY}, identifier=string_id: "/global-infra/domains/<LocalManagerDomain>/groups/<GroupName>"}

• The Group that was identified can be found in Global Manager and also in the other Local Manager.
• As admin user, running "start search resync all" on the impacted Local Manager, did not resolve the issue.
• Using force resync API "POST <LM>/infra/full-sync-action?action=request_full_sync" does not resolve the issue.

 

Environment

VMware NSX

Resolution

To workaround this issue you can:

• Create a new Global Group through Global Manager UI with the same parameters.
• Make sure that the new Global Group is published to both sites.
• Remove the affected Group that was identified in /var/log/proton/nsxapi.log
• Run "start search resync all" in admin mode on every NSX Manager in the affected site. Failure to run this command on all nodes will result in the issue not being fully resolved.

If you preformed the workaround above and the issue persist, please open a support case with Broadcom Support and refer to this KB article.

For more information, see Creating and managing Broadcom support cases.