When IPv6 is disabled vSAN Network related Health checks fail when trying to deploy a remote vSAN datastore for HCI Mesh or the VMware CSI driver fails to provision PVC's on vSAN
Article ID: 326623
Updated On:
Products
VMware vSAN
Issue/Introduction
Symptoms:
The following log entries will be seen in vsanmgmtd.log:
2022-11-17T19:29:25.697Z error vsand[2115572] [opID=Thread-2 VsanHealthSystemImpl::_QueryVerifyNetworkSettings] Failed to fetch ipv6 config from vsi Traceback (most recent call last): File "/usr/lib/vmware/vsan/perfsvc/VsanHealthSystemImpl.py", line 1502, in _QueryVerifyNetworkSettings File "/usr/lib/vmware/vsan/perfsvc/VsanHealthSystemImpl.py", line 455, in _getIpv6AddressFromVsi Exception: Not supported
2022-11-17T19:29:25.714Z error vsand[2115572] [opID=Thread-2 VsanHealthSystemImpl::_QueryVerifyNetworkSettings] Failed to fetch ipv6 route info from vsi Traceback (most recent call last): File "/usr/lib/vmware/vsan/perfsvc/VsanHealthSystemImpl.py", line 1520, in _QueryVerifyNetworkSettings File "/usr/lib/vmware/vsan/perfsvc/VsanHealthSystemImpl.py", line 561, in _getIpRouteInfoByVsi Exception: Not supported
2022-11-17T19:29:25.720Z error vsand[2115572] [opID=Thread-2 VsanHealthUtil::wrapper] Error to run _getIPRouteListFromEsxCLI Traceback (most recent call last): File "/usr/lib/vmware/vsan/perfsvc/VsanHealthSystemImpl.py", line 1520, in _QueryVerifyNetworkSettings File "/usr/lib/vmware/vsan/perfsvc/VsanHealthSystemImpl.py", line 561, in _getIpRouteInfoByVsi Exception: Not supported During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/vmware/vsan/perfsvc/VsanHealthUtil.py", line 1727, in wrapper File "/usr/lib/vmware/vsan/perfsvc/VsanHealthSystemImpl.py", line 518, in _getIPRouteListFromEsxCLI File "/lib64/python3.8/site-packages/pyVmomi/VmomiSupport.py", line 583, in <lambda> File "/lib64/python3.8/site-packages/pyVmomi/VmomiSupport.py", line 373, in _InvokeMethod PyCppVmomi.vim.EsxCLI.CLIFault: (vim.EsxCLI.CLIFault) { msg = 'Received SOAP response fault from [<cs p:0000002a9c122810, TCP:localhost:80>]: list\nEsxCLI
.CLIFault.summary', errMsg = (str) [ 'Ipv6 not Enabled' ] }
2022-11-17T19:29:25.721Z error vsand[2115572] [opID=Thread-2 VsanHealthDaemon::doVsanHealthCheck] Get exception in invoking QueryVerifyNetworkSettings : 'NoneType' object is not iterable
Note: The preceding log excerpts are only examples. Date, time, and environmental variables may vary depending on your environment.
- Cluster is running ESXi version 7.0U2a build 17867351 or lower and vCenter 7.0U2b build 17958471 or lower
- HCI Mesh failed to mount remote vSAN datastore with error message "Failed to run the remote datastore mount pre-checks"
- The VMware CSI driver is unable to provision PVC's on vSAN with the following error: "CnsFault error: VSLM task failed"
The following log entries will be seen in vsanmgmtd.log:
2022-11-17T19:29:25.697Z error vsand[2115572] [opID=Thread-2 VsanHealthSystemImpl::_QueryVerifyNetworkSettings] Failed to fetch ipv6 config from vsi Traceback (most recent call last): File "/usr/lib/vmware/vsan/perfsvc/VsanHealthSystemImpl.py", line 1502, in _QueryVerifyNetworkSettings File "/usr/lib/vmware/vsan/perfsvc/VsanHealthSystemImpl.py", line 455, in _getIpv6AddressFromVsi Exception: Not supported
2022-11-17T19:29:25.714Z error vsand[2115572] [opID=Thread-2 VsanHealthSystemImpl::_QueryVerifyNetworkSettings] Failed to fetch ipv6 route info from vsi Traceback (most recent call last): File "/usr/lib/vmware/vsan/perfsvc/VsanHealthSystemImpl.py", line 1520, in _QueryVerifyNetworkSettings File "/usr/lib/vmware/vsan/perfsvc/VsanHealthSystemImpl.py", line 561, in _getIpRouteInfoByVsi Exception: Not supported
2022-11-17T19:29:25.720Z error vsand[2115572] [opID=Thread-2 VsanHealthUtil::wrapper] Error to run _getIPRouteListFromEsxCLI Traceback (most recent call last): File "/usr/lib/vmware/vsan/perfsvc/VsanHealthSystemImpl.py", line 1520, in _QueryVerifyNetworkSettings File "/usr/lib/vmware/vsan/perfsvc/VsanHealthSystemImpl.py", line 561, in _getIpRouteInfoByVsi Exception: Not supported During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/vmware/vsan/perfsvc/VsanHealthUtil.py", line 1727, in wrapper File "/usr/lib/vmware/vsan/perfsvc/VsanHealthSystemImpl.py", line 518, in _getIPRouteListFromEsxCLI File "/lib64/python3.8/site-packages/pyVmomi/VmomiSupport.py", line 583, in <lambda> File "/lib64/python3.8/site-packages/pyVmomi/VmomiSupport.py", line 373, in _InvokeMethod PyCppVmomi.vim.EsxCLI.CLIFault: (vim.EsxCLI.CLIFault) { msg = 'Received SOAP response fault from [<cs p:0000002a9c122810, TCP:localhost:80>]: list\nEsxCLI
.CLIFault.summary', errMsg = (str) [ 'Ipv6 not Enabled' ] }
2022-11-17T19:29:25.721Z error vsand[2115572] [opID=Thread-2 VsanHealthDaemon::doVsanHealthCheck] Get exception in invoking QueryVerifyNetworkSettings : 'NoneType' object is not iterable
Note: The preceding log excerpts are only examples. Date, time, and environmental variables may vary depending on your environment.
Environment
VMware vSAN 7.0.x
Cause
This issue is caused by a null pointer exception when the network health is queried by the CSI driver or the remote datastore precheck.
Resolution
This issue is resolved by upgrading ESXi to 7.0 U2c build 18426014 and vCenter to 7.0U2c build 18356314 or higher
Additional Information
Impact/Risks:
When IPv6 is disabled, there will be some network latency health check results missing. This will cause mounting a remote datastore to fail for HCI Mesh clusters or the CSI driver to fail provisioning PVCs on vSAN because some critical information is missing in the health check result.
When IPv6 is disabled, there will be some network latency health check results missing. This will cause mounting a remote datastore to fail for HCI Mesh clusters or the CSI driver to fail provisioning PVCs on vSAN because some critical information is missing in the health check result.
Feedback
Yes
No
Powered by
