Applying license in SDDC manager Workload domain fails with error - Failed to add license key. Unable to determine if functionality is allowed/blocked.

Products

• VMware SDDC Manager
• VMware Cloud Foundation

Issue/Introduction

• SDDC manager unable to determine if functionality is allowed/blocked while trying to apply licenses to a workload domain
• While running through the wizard to apply a license key to a workload domain you may see an error in the GUI stating

  "Failed to add license key. Unable to determine if functionality is allowed/blocked."

• Error in /var/log/vmware/vcf/operationsmanager/operationsmanager.log

  [vcf_om,XXXXXXXXX,0f9e] [c.v.v.l.s.LicenseManagerServiceImpl,http-nio-127.0.0.1-7300-exec-5] LicenseKey XXXXX-XXXXX-XXXXX-XXXXX-XXXXX with productType ESXI validated successfully
  [vcf_om,XXXXXXXXX,0f9e] [c.v.v.l.s.u.VsphereLicenseKeyUsagePopulator,http-nio-127.0.0.1-7300-exec-5] About to populate license usage from Psc Populator...
  INFO  [vcf_om,XXXXXXXXX,0f9e] [c.v.v.l.s.client.InventoryClient,http-nio-127.0.0.1-7300-exec-5] Getting Pscs from inventory.
  ERROR [vcf_om,XXXXXXXXX,9efa] [c.v.v.f.t.i.FunctionalityToggleApiFilter,http-nio-127.0.0.1-7300-exec-7] Functionality blocked:
  com.vmware.vcf.functionality.toggle.error.FunctionalityToggleException: Unable to determine if functionality is allowed/blocked.
          at com.vmware.vcf.functionality.toggle.adapter.FunctionalityToggleAdapterImpl.isUnknownFunctionalitySupported(FunctionalityToggleAdapterImpl.java:108)
  
  
  INFO  [common,XXXXXXXXX,462a] [c.v.e.s.i.s.DomainInventoryServiceImpl,http-nio-127.0.0.1-7100-exec-82378] Get all Domains
  ERROR [common,XXXXXXXXX,77b7] [c.v.v.r.s.util.LicensingStateUtil,http-nio-127.0.0.1-7100-exec-82373] Failed to get licensing state. Response code 0
  null
  ERROR [common,XXXXXXXXX,77b7] [c.v.v.r.r.a.c.v.ResourceFunctionalitiesController,http-nio-127.0.0.1-7100-exec-82373] Exception occurred when retrieving the resource functionalities.
  com.vmware.evo.sddc.common.core.error.InvalidStateException: Error encountered while fetching system licensing state.

 

Environment

VMware Cloud Foundation 5.1.1

Cause

This is due to a timeout issue within the commonsvcs application within SDDC manager.

Resolution

1. Take snapshot of SDDC Manager VM
2. SSH to SDDC Manager with vcf and su to root
3. Create a folder to take backup of common service properties file

   mkdir /home/vcf/csbackup

4. Take a backup of application properties

   cp /etc/vmware/vcf/commonsvcs/application.properties /home/vcf/csbackup/

5. Append the new property to common services property file using

   echo "license.service.api.client.timeout.millis=60000" >> /etc/vmware/vcf/commonsvcs/application.properties

6. Restart common services

   systemctl restart commonsvcs