Unable to update BOM components from the SDDC Manager with the error "Update cannot be started now as compatibility file is missing"
search cancel

Unable to update BOM components from the SDDC Manager with the error "Update cannot be started now as compatibility file is missing"

book

Article ID: 396202

calendar_today

Updated On:

Products

VMware SDDC Manager / VCF Installer VCF Operations

Issue/Introduction

  • In the Updates tab of the relevant WLD, the "Update Now" or "Configure Update" button is greyed out.
  • The error "Update cannot be started now as compatibility file is missing" is observed in the "Available Updates" section of the Updates Tab.
  • Attempting to manually download the VmwareCompatibilityData.json file fails.
  • In the /var/log/vmware/vcf/lcm/lcm-debug.log file of the SDDC manager, the following entries may be observed:

YYYY-MM-DDTHH:MIN DEBUG [vcf_lcm,<UUID>,####] [c.v.e.s.l.b.d.depot.DepotDownloader,Scheduled-1] Getting file size for [/COMP/SDDC_MANAGER_VCF/manifests/bundle-24282.manifest.sig] from URL[https://dl.broadcom.com:443/<token id>/PROD/COMP/SDDC_MANAGER_VCF/manifests/bundle-24282.manifest.sig]
YYYY-MM-DDTHH:MIN DEBUG [vcf_lcm,<UUID>,####] [c.v.e.s.l.b.d.depot.DepotDownloader,Scheduled-1] Executing HEAD /<token id>/PROD/COMP/SDDC_MANAGER_VCF/manifests/bundle-24282.manifest.sig
YYYY-MM-DDTHH:MIN INFO  [vcf_lcm,<UUID>,####] [o.a.h.c.h.i.c.HttpRequestRetryExec,Scheduled-9] Recoverable I/O exception (java.net.SocketException) caught when processing request to {s}->https://<endpoint-address>:443
YYYY-MM-DDTHH:MIN ERROR [vcf_lcm,<UUID>,####] [c.v.e.s.l.c.s.VmwareCompatibilityDataDownloadScheduler,Scheduled-9] VVS Compatibility Data update failed
com.vmware.vcf.compatibility.controllers.internal.vvs.exception.VvsException: The VVS api call to https://vvs.esp.vmware.com/v1/products/bundles/type/vcf-lcm-bundle?format=json failed. Response: Connection reset
        at com.vmware.vcf.compatibility.controllers.internal.vvs.rest.client.VvsApiClient.getBundlesFromApi(VvsApiClient.java:146)
        at com.vmware.vcf.compatibility.controllers.internal.vvs.rest.client.VvsApiClient.getAllProductBundleDetails(VvsApiClient.java:88)
        at com.vmware.vcf.compatibility.controllers.internal.vvs.VvsCompatibilityController.getCompatibilityDataFromRemote(VvsCompatibilityController.java:490)
        at com.vmware.vcf.compatibility.validator.internal.CompatibilityControllerAggregator.getCompatibilityDataFromRemote(CompatibilityControllerAggregator.java:1234)
        at com.vmware.vcf.compatibility.validator.internal.CompatibilityControllerAggregator.getCompatibilityDataFromRemote(CompatibilityControllerAggregator.java:1222)
        at com.vmware.vcf.compatibility.validator.internal.service.CompatibilityValidatorServiceImpl.getCompatibilityDataFromRemote(CompatibilityValidatorServiceImpl.java:240)
        at com.vmware.vcf.compatibility.client.service.impl.CompatibilityValidatorClientImpl.getCompatibilityDataFromRemote(CompatibilityValidatorClientImpl.java:670)
        at com.vmware.evo.sddc.lcm.services.impl.UpgradeCompatibilityServiceImpl.getCompatibilityDataFromRemote(UpgradeCompatibilityServiceImpl.java:722)
        at jdk.internal.reflect.GeneratedMethodAccessor628.invoke(Unknown Source)

  • After an upgrade to 9.1, SDDC lifecycle binaries failed to sync with the following error:
  • Logs from /var/log/vmware/vcf/lcm/lcm-debug.log  show:

[vcf_1cm, <UUID>, ####] [c. v.v. c. c. i. v. VvsCompatibilityController, Scheduled-7] Compatibility data failed to update the file with exception
java. nio. file.AccessDeniedException: /nfs/vmware/vcf/nfs-mount/compatibility/VmwareCompatibilityData. json. tmp
     at java . base/sun. nio. fs.UnixException. translateToIOException (UnixException. java : 90)
     at java. base/sun. nio. fs. UnixException. rethrowAsIOException (UnixException. java: 106)
     at java. base/sun. nio. fs. UnixException. rethrowAsIOException (UnixException. java : 111)
     at java. base/sun.nio. fs.UnixFileSystemProvider. newByteChannel (UnixFileSystemProvider. java: 261)
     at java. base/java.nio. file. Files. newByteChannel (Files. java : 380)
     at java.base/java.nio.file. Files.createFile (Files. java: 658)
     at com. vmware. vcf . compatibility. controllers. common. ControllerFileUtil.createFileIfNotPresent (ControllerFileUtil. java : 93)
     at com. vmware. vcf. compatibility. controllers. common. ControllerFileUtil.writeDataToFileThroughTempFile (ControllerFileUtil. java : 53)
     at com. vmware. vcf. compatibility. controllers. internal . vvs. VvsCompatibilityController . putCompatibilityData (VvsCompatibilityController. java: 225)
     at com. vmware. vcf. compatibility. validator. internal . CompatibilityControllerAggregator .putCompatibilityData (CompatibilityControllerAggregator. java : 948)
     at com. vmware. vcf . compatibility. validator. internal. service. CompatibilityValidatorServiceImpl. putCompatibilityData (CompatibilityValidatorServiceImpl. java : 324)
     at com. vmware. vcf. compatibility. client. service. impl. CompatibilityValidatorClient Impl.putCompatibilityData (CompatibilityValidatorClient Impl. java : 650)
     at com. vmware. evo. sddc. lcm. services . impl. UpgradeCompatibilityServiceImpl . putCompatibilityData (UpgradeCompatibilityServiceImpl. java : 500)
     at java. base/jdk. internal . reflect . DirectMethodHandleAccessor . invoke (DirectMethodHandleAccessor . java : 103)
     at java.base/java. lang. reflect. Method. invoke (Method. java : 580)



Environment

VMware Cloud Foundation 5.0,
VCF Operations 9.1

Cause

This issue occurs because the compatibility file /nfs/vmware/vcf/nfs-mount/compatibility/VmwareCompatibilityData.json is missing on the SDDC Manager appliance.

  • The most likely reason for the missing compatability data is that the SDDC manager was upgraded from a previous version where this directory did not exist.
  • VVS compatability data was added in VCF 5.0.0.0.

Resolution

Add the compatibility data into the SDDC manager manually

Steps to download the compatability data:

  1. Take an offline snapshot of the SDDC Manager appliance.
  2. SSH into the SDDC Manager with the vcf user and elevate to root with su root
  3. Create and navigate into the compatability directory:
    • mkdir /nfs/vmware/vcf/nfs-mount/compatibility/
    • cd /nfs/vmware/vcf/nfs-mount/compatibility/
  4. Run the following command to download the VmwareCompatibilityData.json file:
    • curl --location 'https://vvs.broadcom.com/v1/products/bundles/type/vcf-lcm-v2-bundle?format=json' --header 'X-Vmw-Esp-ClientId: vcf-lcm' > VmwareCompatibilityData.json
  5. Set the correct permissions and ownership to the compatability directory
    • chown vcf_lcm:vcf -R /nfs/vmware/vcf/nfs-mount/compatibility
    • chmod 755 -R /nfs/vmware/vcf/nfs-mount/compatibility/
  6. Restart the LCM service for the changes to take effect:
    • systemctl restart lcm

Note: If the SDDC Manager lacks internet access, run the download command on a different Linux machine with access to vvs.broadcom.com, then transfer/copy the file to the appliance.

Update Depot URLs

Additional Information

Public URL list for VCF Products

VCF authenticated downloads configuration update instructions

Powered by Wolken Software