Error: LCMCOMMON80049 Unable to sync inventory on any VCF components

Products

• VCF Operations
• VMware vCenter Server

Issue/Introduction

When attempting to sync the inventory on any VMware Cloud Foundation (VCF) component VCF Operations > Fleet Management > Lifecycle VCF Management, the sync process fails.

The following error is observed in the UI:

Error Code: LCMCOMMON80049
 
Failed to find the product or its nodes in the provided vCenters. Make sure all the nodes are part of the vCenter's currently provided. If not add missing vCenter's details. Also make sure the credentials for all the provided vCenters are valid. Additionally, verify if the vCenter password saved in locker is consistent with the actual vCenter password. If it is not, update the password in locker and retry.
 
Failed to find the product in the specified vCenter. vRealize Network Insight instance with hostname or IP ###.###.###.### not found in given vCenter details. Make sure node is powered on in the vCenter Server. Make sure all the nodes are present in the vCenter Servers provided. Else, add the missing vCenter Servers. Ensure the credentials provided for the vCenter Servers are valid or skip the task using the 'Skip vCenter validation' option during retry.

On the Lifecycyle Manager appliance in /var/log/vrlcm/vmware_vrlcm.log you see: 

INFO vrlcm[1259] [http-nio-8080-exec-10] [c.v.v.l.a.g.s.EngineServiceImpl] – Error Cause ::
{
"messageId" : "LCMCOMMON80049",
"message" : "Failed to find the product or its nodes in the provided vCenters. Make sure all the nodes are part of the vC
enter's currently provided. If not add missing vCenter's details. Also make sure the credentials for all the provided vCent
ers are valid. Additionally, verify if the vCenter password YXYXYXYX in locker is consistent with the actual vCenter passwo
rd. YXYXYXYX is not, update the password YXYXYXYX and retry.",

INFO vrlcm[1259] [http-nio-8080-exec-9] [c.v.v.l.a.g.s.EngineServiceImpl] – Error Cause ::
{
"messageId" : "LCMCOMMON80025",
"message" : "Check if the entered IP address/ FQDN is correct or the vCenter Server server is not reachable with VCF Oper
ations Fleet Management. If the vCenter Server is powered off, then power it on and click Retry.",

Attempting to sync the vCenter server in question from VCF Operations > Fleet Management > Lifecycle > VCF Management > Settings > Deployment Targets > Click Refresh button:

com.vmware.vrealize.lcm.common.exception.EngineException: Ssl Exception occured com.vmware.vim.vmomi.client.exception.SslException: com.vmware.vim.vmomi.core.exception.CertificateValidationException: Server certificate chain is not trusted and thumbprint doesn't match at com.vmware.vrealize.lcm.drivers.commonplugin.task.VcInventoryValidateTask.execute(VcInventoryValidateTask.java:135) at com.vmware.vrealize.lcm.automata.core.TaskThread.run(TaskThread.java:62) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source)

 

Environment

• VCF Operations 9.0.2
• vCenter Server 9.x

 

Cause

This issue occurs when the Fleet Management appliance is unable to trust the specified vCenter Server certificate.

Resolution

To resolve this issue, manually execute a certificate check against the affected vCenter Server using the Fleet Management Swagger API.

1. Log in to the Fleet Management appliance using the admin@local credentials at https://<fleet_management_FQDN>/.

2. Navigate to the Swagger UI endpoint: https://<fleet_management_FQDN>/api/swagger-ui/index.html.

3. Expand the Certificate Management Controller section.

4. Expand the POST section and select Try it Out.

5. In the input box under the endpoint, enter the FQDN for the vCenter Server encountering the issue.

6. Click Execute to force the appliance to retrieve and accept the certificate.

7. Return to the standard UI and retry the inventory sync.