vSAN Top Contributors Query Fails Beyond 4 Hours with Error. "Unable to query data, Try again later"

Products

• VMware vSAN

Issue/Introduction

• On a vSAN ESA cluster, querying performance data from the Top Contributors tab fails when selecting a time range greater than 4 hours.

  Error seen in the vCenter UI, “

  Unable to query data, try again later"

  
  
  
  

• Only the Top Contributors tab is affected; other performance views (VM, backend, I/O Insight, etc.) function as expected.

• In /var/log/vmware/vsan-health/vsanvcmgmtd.log, the following error is logged

  2025-08-29T12:03:27.904+10:00 info vsanvcmgmtd[09474] [vSAN@6876 sub=vmomi.soapStub[14475] opID=agw-0009107-9b71] SOAP request returned HTTP failure; <<io_obj p:0x00007f01f4159c38, h:66, <UNIX ''>, <UNIX '/var/run/envoy-hgw/hgw-pipe'>>, /hgw/host-xxxx/vsan>, method: queryVsanPerfHotspotEntities; code: 500(Internal Server Error); fault: (vmodl.fault.InvalidArgument) {
  
  -->    faultCause = (vmodl.MethodFault) null,
  
  -->    faultMessage = (vmodl.LocalizableMessage) [
  
  -->       (vmodl.LocalizableMessage) {
  
  -->          key = "com.vmware.vsan.perfsvc.fault.queryexceedstimerange",
  
  -->          arg = <unset>,
  
  -->          message = "Time duration of the query exceeds threshold."
  
  -->       }
  
  -->    ],
  
  -->    invalidProperty = "startTime/endTime"
  
  -->    msg = "Received SOAP response fault from [<<io_obj p:0x00007f01f4159c38, h:66, <UNIX ''>, <UNIX '/var/run/envoy-hgw/hgw-pipe'>>, /hgw/host-580771/vsan>]: queryVsanPerfHotspotEntities
  
  --> Time duration of the query exceeds threshold."

 

 

 

Environment

VMware vSAN 8.x

Cause

The Top Contributors feature supports:

• Up to 24 hours query range when the performance interval is set to 300 seconds (default).

• If the interval is set to 60 seconds, the system restricts queries to ~4.8 hours (17,280 seconds ÷ 60s)

• [root@xxx-205:~] cat /etc/vmware/vsan/vsanperf.conf
  [VSANPERF]
  port = 9095
  metrics_port = 9097
  namespace = /vsanperf
  https_tunnel = True
  keyfile = /etc/vmware/ssl/rui.key
  certfile = /etc/vmware/ssl/rui.crt
  ca_certs = /etc/vmware/ssl/castore.pem
  cert_reqs = True
  no_auth = False
  interval = 60 <--

Resolution

1. Edit the vSAN performance configuration file:

    
   /etc/vmware/vsan/vsanperf.conf

2. Update the interval back to the default:

    
   interval = 300

3. Save the changes and restart the vSAN performance service.

After the interval is restored to 300 seconds, Top Contributors queries will support the full 24-hour range.