Unable to query vSAN health information. Check vSphere Client logs for details

Products

• VMware vCenter Server

Issue/Introduction

Unable to view VSAN Health on any cluster in vCenter Server.

Error in vSphere client when accessing Skyline Health, "Unable to query vSAN health information. Check vSphere Client logs for details."

Additional error when accessing Virtual Objects, "Http failure response for https://<VC FQDN>/ui/h5-vsan/rest/proxy/service/com.vmware.vsan.client.services.capability.VsanCapabilityProvider/getIsObjectIdentitiesSupportedOnCluster: 403 OK"

The following error is seen in /var/log/vmware/vsphere-ui/logs/vsphere_virgo_client.log

Uncaught (in promise): Http failure response for https://<VC FQDN>/ui/h5-vsan/rest/proxy/service/com.vmware.vsan.client.util.VsanInventoryHelper/getCluster: 403 OK","Error: Uncaught (in promise): Http failure response for https://<VC FQDN>/ui/h5-vsan/rest/proxy/service/com.vmware.vsan.client.util.VsanInventoryHelper/getCluster: 403 OK\n

/var/log/vmware/vsan-health/vsanvcmgmtd.log reports the below events, specifically, "HTTP Connection read failed while waiting for further requests"

<timestamp> info vsanvcmgmtd[16406] [vSAN@6876 sub=VsanSoapSvc.HTTPService.HttpConnection opId=SWI-6f38b951-9284] HTTP Connection read failed while waiting for further requests; <io_obj p:0x00007fe0280b8760, h:-1, <UNIX '/var/run/vmware-vsan/vsan-sdk-pipe'>, <UNIX ''>>, N7Vmacore16TimeoutExceptionE(Operation timed out: Stream: <io_obj p:0x00007fe0280b8760, h:-1, <UNIX '/var/run/vmware-vsan/vsan-sdk-pipe'>, <UNIX ''>>, duration: 00:00:46.021331 (hh:mm:ss.us))

<timestamp> info vsanvcmgmtd[16495] [vSAN@6876 sub=VsanSoapSvc.HTTPService.HttpConnection opId=sps-Main-384157-360-392799-84a6] HTTP Connection read failed while waiting for further requests; <io_obj p:0x000055ef93bee080, h:-1, <UNIX '/var/run/vmware-vsan/vsan-sdk-pipe'>, <UNIX ''>>, N7Vmacore16TimeoutExceptionE(Operation timed out: Stream: <io_obj p:0x000055ef93bee080, h:-1, <UNIX '/var/run/vmware-vsan/vsan-sdk-pipe'>, <UNIX ''>>, duration: 00:00:46.327889 (hh:mm:ss.us))

Environment

vCenter Server 7.x

Cause

API Calls to vsan-health were being blocked by intrusion detection.
Specifically against the CVE, CVE-2021-21985

Resolution

Review any Intrusion detection software that is preventing API calls from completing.
Review logs under /var/log/vmware/vsan-health to further diagnose the http failure if there are no intrusion detection softwares in use.