vSAN Skyline Health alert: "All hosts contributing stats"

Products

• VMware vSAN

Issue/Introduction

Symptoms:

• Performance statistics are collected only from the stats master node. All other ESXi hosts in the cluster show a "All hosts contributing stats" health alert.

Environment

• VMware vSAN 8.x

Cause

• The vsanmgmt logs on the affected ESXi hosts indicate that the https_tunnel entry is missing from the /etc/vmware/vsan/vsanperf.conf configuration file. This configuration parameter is required to enable secure inter-host communication (HTTPS tunnel) for performance statistics collection within the vSAN cluster.
• From the /var/run/log/vsanmgmt.log entries, the root cause is a missing https_tunnel configuration parameter in the /etc/vmware/vsan/vsanperf.conf file. The log messages confirm that the vsanmgmt service is unable to load the required HTTPS tunnel setting.

2025-08-21T12:09:27.714Z Er(11) vsand[26497689]: [opID=MainThread cliutils::LoadUseHTTPSTunnelConfig] Fail to get the value of the option 'https_tunnel' fromconf file /etc/vmware/vsan/vsanperf.conf
2025-08-21T12:09:27.714Z Er(11)[+] vsand[26497689]: Traceback (most recent call last):
2025-08-21T12:09:27.714Z Er(11)[+] vsand[26497689]:   File "/lib64/python3.11/collections/__init__.py", line 1012, in __getitem__
2025-08-21T12:09:27.714Z Er(11)[+] vsand[26497689]:   File "/lib64/python3.11/collections/__init__.py", line 1004, in __missing__
2025-08-21T12:09:27.714Z Er(11)[+] vsand[26497689]: KeyError: 'https_tunnel'
2025-08-21T12:09:27.714Z Er(11)[+] vsand[26497689]: Traceback (most recent call last):
2025-08-21T12:09:27.714Z Er(11)[+] vsand[26497689]:   File "/usr/lib/vmware/vsan/perfsvc/cliutils.py", line 90, in LoadUseHTTPSTunnelConfig
2025-08-21T12:09:27.714Z Er(11)[+] vsand[26497689]: configparser.NoOptionError: No option 'https_tunnel' in section: 'VSANPERF'

• As a consequence, the statscollector::RetrieveRemoteStats process fails when attempting to establish connections between ESXi hosts for remote statistics retrieval:

2025-08-21T12:09:58.723Z Er(11) vsand[26497718]: [opID=vsan-7cc06724-######### statscollector::RetrieveRemoteStats] RetrieveRemoteStats_VsiConnector exception: VMK vmk1 can not connect to host ##.###.###.##.
2025-08-21T12:09:58.723Z Er(11)[+] vsand[26497718]: Traceback (most recent call last):
2025-08-21T12:09:58.723Z Er(11)[+] vsand[26497718]:   File "/usr/lib/vmware/vsan/perfsvc/statscollector.py", line 1293, in RetrieveRemoteStats
2025-08-21T12:09:58.723Z Er(11)[+] vsand[26497718]:   File "/usr/lib/vmware/vsan/perfsvc/VsanHealthUtil.py", line 1906, in VsanPerfCreateConnection
2025-08-21T12:09:58.723Z Er(11)[+] vsand[26497718]: TimeoutError: timed out
2025-08-21T12:09:58.724Z Wa(12) vsand[26497718]: [opID=vsan-7cc06724-######## statscollector::RetrieveRemoteStats] RetrieveRemoteStats_VsiConnector warning: no available vmknic to retrieve remote stats.

• This leads to non-master hosts being unable to contribute performance statistics, which triggers the "All hosts contributing stats" health check alert.

Resolution

1. Edit the vSAN performance configuration file:
   • vi /etc/vmware/vsan/vsanperf.conf


2. Under the [VSANPERF] section, add the following line:
   • https_tunnel = True


3. Save the file and restart the vSAN management service:
   • /etc/init.d/vsanmgmtd restart


4. Validate that the ESXi host firewall is now configured with https_tunnel enabled and confirm that remote stats collection is restored.