WORKLOAD DOMAINS fails to load in the SDDC Manager with Error: Failed to load cluster details. Something went wrong. Please retry or contact the server provider and provide the reference token.

Products

• VCF Operations
• VMware SDDC Manager / VCF Installer

Issue/Introduction

• In the VMware Cloud Foundation (VCF) environment, the SDDC Manager dashboard dashboard fails to populate or load the Workload Domain details.
• A banner notification displays the error message: Failed to load cluster details. Something went wrong. Please retry or contact the server provider and provide the reference token.
  
  
  
  
• The Host details view appears entirely empty.
  
  
  
  
• The VMware Cloud Foundation (VCF) Operations Manager successfully lists the complete infrastructure topology and inventory.
  
  
  
  
• Under the SDDC Manager's /var/log/vmware/vcf/domainmanager/domainmanager.log,  below error log snips are found:
  
  YYYY-MM-DDTHH:MM:SS ERROR [vcf_dm,########,####] [c.v.v.r.c.c.ResourceAggregatorServiceImpl,http-nio-127.0.0.1-7200-exec-#] Failed to get clusters information from resource aggregator.
com.vmware.cloud.foundation.rest.operationsmanager.internal.runtime.ApiException:
        at com.vmware.cloud.foundation.rest.operationsmanager.internal.runtime.ApiClient.handleResponse(ApiClient.java:788)
        at com.vmware.cloud.foundation.rest.operationsmanager.internal.runtime.ApiClient.execute(ApiClient.java:708)
...
YYYY-MM-DDTHH:MM:SS WARN [vcf_dm,########,####] [c.v.v.c.s.i.ClusterManagerIsServiceImpl,http-nio-127.0.0.1-7200-exec-#] Failed to get clusters information from resource aggregator. Cluster capacity information (CPU, Storage, Memory) won't be provided in the response.
YYYY-MM-DDTHH:MM:SS ERROR [vcf_dm,########,####] [o.a.c.c.C.[.[.[.[dispatcherServlet],http-nio-127.0.0.1-7200-exec-#] Servlet.service() for servlet [dispatcherServlet] in context with path [/domainmanager] threw exception [Request processing failed: java.lang.NullPointerException: element cannot be mapped to a null key] with root cause
java.lang.NullPointerException: element cannot be mapped to a null key
        at java.base/java.util.Objects.requireNonNull(Objects.java:235)
        at java.base/java.util.stream.Collectors.lambda$groupingBy$53(Collectors.java:1142)
  
  

Environment

• VCF Operations Manager
• SDDC Manager

Cause

An incomplete or failed historical Workload Domain deletion process leaves behind a stale Workload Domain entry that is trapped permanently in a DEACTIVATING state within the SDDC Manager core database inventory. When the UI attempts to render the inventory, the aggregator fails to map certain null attributes tied to the stale entry, breaking the API response.

Resolution

To resolve this issue, please raise a case with Broadcom Customer Support