SDDC Manager upgrade precheck error : vSAN HCL DB on is out of date in SDDC manager UI

Products

• VMware Cloud Foundation

Issue/Introduction

• The SDDC Manager upgrade precheck fails with the error: vSAN HCL DB on SDDC Manager is out of date. This is a critical error if vSAN HCL DB has not been updated within the last 90.0 day(s).

• Skyline health checks in vCenter may show as up-to-date, but SDDC Manager reports a stale HCL database.
• Manual bundle uploads via the SDDC Manager UI or Bundle Transfer Utility appear successful but do not clear the precheck error.
• On verifying the vsan hcl db update version in vcenter at vcenter-->configure-->vsan-->Update its already at the latest version

• Skyline health checks for vsan "Hardware compatibility" shows green for vSAN HCL up-to-date
• Updating vsan HCL DB via OBTU fails with
  • Bundle Transfer Utility Tool failed with error :
    
    Api call to /v1/vsan-hcl/content failed.
Caused by: java.lang.IllegalArgumentException: URI path begins with multiple slashes

 

Environment

• VMware Cloud Foundation (VCF) 5.x, 9.x

Cause

 This issue occurs when the vsan_hcl_attributes table in the SDDC Manager LCM database fails to synchronize with the manually uploaded HCL data, resulting in a stale local_data_timestamp.

Resolution

1. Take snapshot of SDDC Manager VM
   
   

2. Verify Database Timestamp: SSH to the SDDC Manager as root and execute the following to check the current HCL timestamp:

   ts=$(psql -h localhost -U postgres -d lcm -t -A -c "select local_data_timestamp from vsan_hcl_attributes;"); date -d@"$ts"

    

   • If the date is outdated, proceed with the manual update. - Updating the vSAN HCL database manually

3. Download latest HCL data: Save https://vvs.broadcom.com/service/vsan/all.json as all.json (Right click, Save as) and Copy all.json file from your local machine to /home/vcf folder onto your SDDC Manager via tools like WinSCP.

   1. Obtain Access Token (on your SDDC manager CLI):

      curl -k --location 'https://localhost/v1/tokens' --header 'Content-Type: application/json' --data-raw '{"username":"","password":""}'

   2. Upload HCL via API (on your SDDC manager CLI): Navigate to /home/vcf and run:

      curl -k -X PUT --location 'https://localhost/v1/vsan-hcl/content' --header 'Authorization: Bearer <access token> ' --header 'Content-Type: text/plain' [email protected]

   3. Validation: Re-run the command from Step 2 to verify the local_data_timestamp is updated. Retry the upgrade precheck in the SDDC Manager UI.

   4. Retry the pre-check to verify that SDDC no longer complain that vSAN HCL DB on SDDC Manager is out of date

Additional Information

• Executing the commands from steps 1 and 2 might fail with an error: "curl: (7) Failed to connect to port 80 after 0 ms: Couldn't connect to server" due to a use of http instead of https.

For further assistance, Contact Support. To receive updates on this issue, subscribe to this article.