Cloud Proxy collection failure and workload domain import errors
search cancel

Cloud Proxy collection failure and workload domain import errors

book

Article ID: 443680

calendar_today

Updated On:

Products

VCF Operations

Issue/Introduction

When attempting to import an existing vCenter and NSX as a workload domain in a VMware Cloud Foundation (VCF) deployment, the following symptoms occur:

  • The certificate thumbprint validation stage fails with a generic Loading data error.
  • The SDDC Manager page within the VCF Operations UI displays a blank page.
  • Cloud Proxy data collection stops working, and the VCF Adapter status shows as Failed.
  • Restarts of the VCF Adapter collector do not resolve the issue.
  • SDDC Manager Logs

    The logs show frequent socket timeouts and API communication failures:

    /var/log/vmware/vcf/domainmanager/domainmanager.log

    Unexpected error occurred in scheduled task
    com.vmware.evo.sddc.common.services.error.SddcManagerServicesIsException: Workload Domain Details Not Found.
    *
    *
    *
    Caused by: com.vmware.cloud.foundation.rest.commonsvcs.runtime.ApiException: java.net.SocketTimeoutException: Connect timed out
    
    Auto Sync failed due to
    com.vmware.cloud.foundation.rest.commonsvcs.runtime.ApiException: Bad Gateway

    /var/log/vmware/vcf/operationsmanager/operationsmanager.log

    Failed to update vCenter tasks
    com.vmware.vcf.rest.api.runtime.ApiException: java.net.SocketTimeoutException: Connect timed out
    
    failed to get sddcManager controller.
    com.vmware.cloud.foundation.rest.commonsvcs.runtime.ApiException: java.net.SocketTimeoutException: timeout

    VCF Operations Adapter (VcfAdapter.log):

    /log/adapters/VcfAdapter/VcfAdapter_###.log

    WARN VcfAdapter [ops@4413] - Exception occurred while connecting to url https://<SDDC-FQDN>/v1/tokens com.vmware.vrops.adapter.vcf.exception.VcfException: Request is taking longer time than expected, please try again in sometime

Environment

  • VCF Operations 9.0.x
  • VCF SDDC 9.0.x
  • VCF Fleet Manager 9.0.x

Cause

This issue is caused by a communication timeout and API synchronization failure between the VCF Operations adapter and the SDDC Manager services. Internal trust or UI state flags may also prevent inventory data from loading correctly.

Resolution

Follow the steps below to restore UI visibility and fix data collection.

Step 1: Enable UI Visibility in Fleet Manager

To ensure passwords and certificates are visible in the Fleet Manager UI:

  1. Create a snapshot of the Fleet Manager appliance.
  2. Log in to the Fleet Manager appliance via SSH using root credentials.
  3. Run the following command to force-enable the UI components: touch /var/lib/vrlcm/UI_ENABLED

Step 2: Restore SDDC Adapter Data Collection

  1. Create a snapshot of the SDDC Manager appliance (without memory).
  2. Perform the certificate and inventory synchronization steps detailed in KB 419281: Fleet Management fails to load SDDC Inventory information of Passwords and Certificates
  3. Navigate to VCF Operations Integrations > VCF Adapter, edit the adapter instance, and re-validate the connection to accept any updated thumbprints.