Skyline health report warnings "vSAN HCL DB up to date" and "vSAN HCL DB Auto Update" - VSAN
search cancel

Skyline health report warnings "vSAN HCL DB up to date" and "vSAN HCL DB Auto Update" - VSAN

book

Article ID: 443050

calendar_today

Updated On:

Products

VMware vSAN VMware Cloud Foundation

Issue/Introduction

Symptoms :

  • The VMware vSAN Skyline Health reports warnings or errors as mentioned below:

    • vSAN HCL DB up to date.
    • vSAN HCL DB Auto Update.

  • These alerts trigger when the HCL database has not been updated within the standard 90-day (Warning) or 180-day (Error) thresholds.
  • Navigate to vCenter > Configure > vSAN > Internet connectivity and confirm that the internet is enabled on the vCenter.
  • Click on troubleshoot option for the warning "vSAN HCL DB Auto Update" to confirm that the HCL DB copy last updated was crossed 90 or 180 days limit.
  • Attempts to update the database via the "GET LATEST VERSION ONLINE" button fails. The vSphere Client displays the following error message:

    Failed to replace old HCL with new one.



    Note: To download the HCL database online from the official website, the vCenter should be able to reach and open the URL "https://partnerweb.vmware.com/service/vsan/all.json".

Environment

  • VMware vSAN

Cause

The vCenter Server failed to open the official HCL release URL "https://partnerweb.vmware.com/service/vsan/all.json".

  • The /var/log/vmware/vsan-health/vmware-vsan-health-service.log file from the vCenter confirms that the vCenter failed to open the URL "https://partnerweb.vmware.com/service/vsan/all.json". It failed with error "Connection reset by peer".

    YYYY-MM-DDTHH:MM:SS.SSS-SS:SS INFO vsan-mgmt[09653] [VsanHclUtil::updateHclDbFromUrl opID=###-#######-####] Start to update VSAN hcl db from url https://partnerweb.vmware.com/service/vsan/all.json
    YYYY-MM-DDTHH:MM:SS.SSS-SS:SS ERROR vsan-mgmt[09653] [VsanHttpRequestWrapper::urlopen opID=###-#######-####] Exception while sending request : <urlopen error [Errno 104] Connection reset by peer>
    YYYY-MM-DDTHH:MM:SS.SSS-SS:SS ERROR vsan-mgmt[09653] [VsanHclUtil::updateHclDbFromUrl opID=###-#######-####] Retrieve HclDb from web exception:<urlopen error [Errno 104] Connection reset by peer>
    YYYY-MM-DDTHH:MM:SS.SSS-SS:SS ERROR vsan-mgmt[09653] [VsanVcClusterHealthSystemImpl::UpdateHclDbFromWeb opID=###-#######-####] Failed to update DB: <urlopen error [Errno 104] Connection reset by peer>
    Traceback (most recent call last):
      File "/usr/lib/python3.10/urllib/request.py", line 1348, in do_open
      File "/usr/lib/python3.10/http/client.py", line 1303, in request
      File "/usr/lib/python3.10/http/client.py", line 1349, in _send_request
      File "/usr/lib/python3.10/http/client.py", line 1298, in endheaders
      File "/usr/lib/python3.10/http/client.py", line 1058, in _send_output
      File "/usr/lib/python3.10/http/client.py", line 996, in send
      File "/usr/lib/python3.10/http/client.py", line 1475, in connect
      File "/usr/lib/python3.10/ssl.py", line 513, in wrap_socket
      File "/usr/lib/python3.10/ssl.py", line 1104, in _create
      File "/usr/lib/python3.10/ssl.py", line 1375, in do_handshake
    ConnectionResetError: [Errno 104] Connection reset by peer

    During handling of the above exception, another exception occurred:

    Traceback (most recent call last):
      File "bora/vsan/health/vpxd/pyMoVsan/VsanVcClusterHealthSystemImpl.py", line 12193, in UpdateHclDbFromWeb
      File "bora/vsan/health/vpxd/pyMoVsan/VsanHclUtil.py", line 550, in updateHclDbFromUrl
      File "bora/vsan/health/vpxd/pyMoVsan/VsanHclUtil.py", line 529, in updateHclDbFromUrl
      File "bora/vsan/health/vpxd/pyMoVsan/VsanHclUtil.py", line 488, in _getHttpResponse
      File "bora/vsan/health/vpxd/pyMoVsan/VsanHttpRequestWrapper.py", line 199, in urlopen
      File "bora/vsan/health/vpxd/pyMoVsan/VsanHttpRequestWrapper.py", line 192, in urlopen
      File "/usr/lib/python3.10/urllib/request.py", line 216, in urlopen
      File "/usr/lib/python3.10/urllib/request.py", line 519, in open
      File "/usr/lib/python3.10/urllib/request.py", line 536, in _open
      File "/usr/lib/python3.10/urllib/request.py", line 496, in _call_chain
      File "/usr/lib/python3.10/urllib/request.py", line 1391, in https_open
      File "/usr/lib/python3.10/urllib/request.py", line 1351, in do_openurllib.error.URLError: <urlopen error [Errno 104] Connection reset by peer>

  • Running the curl command from the vCenter SSH sessions fails with error "Connection reset by peer in connection to partnerweb.vmware.com:443"

    curl -v https://partnerweb.vmware.com/service/vsan/all.json
    * Host partnerweb.vmware.com:443 was resolved.
    * IPv6: ####:####:#::##, ####:####:#::##
    * IPv4: ###.##.#.###, ###.##.#.###
    *   Trying [####:####:#::##]:443...
    * Immediate connect fail for ####:####:#::##: Cannot assign requested address
    *   Trying ####:####:#::##:443...
    * ALPN: curl offers http/1.1
    * TLSv1.3 (OUT), TLS handshake, Client hello (1):
    *  CAfile: /etc/pki/tls/certs/ca-bundle.crt
    *  CApath: none
    * Recv failure: Connection reset by peer
    * TLS connect error: error:00000000:lib(0)::reason(0)
    * OpenSSL SSL_connect: Connection reset by peer in connection to partnerweb.vmware.com:443 
    * closing connection #0
    curl: (35) Recv failure: Connection reset by peer

Resolution

vSAN HCL DB up to date:

vSAN HCL DB Auto Update :

  • Engage networking team to ensure the vCenter can reach and open the URL "https://partnerweb.vmware.com/service/vsan/all.json".