Sync Inventory from VCF operation fails - Import operation for sync with id ###-###-###-### failed internally.

Products

• VMware SDDC Manager

Issue/Introduction

• After making a out-of-band change for VCF 9.0, you are performing Sync inventory using the VCF operations for the SDDC manager domain - Manage VCF Domain Configuration Drift
  VCF Operations > Inventory > VCF Instances > VCF domain > Actions > Sync Inventory.
  
  
• The sync tasks fails with an internal error 

  Message: Import operation for sync with id ###-###-###-### failed internally. Command was python3 /opt/vmware/vcf/domainmanager/scripts/vcf-import-tool/vcf_brownfield.py sync --domain-name <domain_name> --skip-ssh-thumbprint-validation --internal-vcf-auth --output-dir /var/log/vmware/vcf/domainmanager/brownfield/###-###-###-###/ --non-interactive. Please check the log files located in /var/log/vmware/vcf/domainmanager/brownfield/###-###-###-###/ on the SDDC Manager appliance
  Remediation Message:
  Reference Token: ####
  Cause:

• Navigate to the log location present in the error message. You will find the sync failed for the vCenter server guardrails
  /var/log/vmware/vcf/domainmanager/brownfield/###-###-###-###/

  [yyyy-mm-dd hh:mm:ss] [INFO] check_domain_reporter:51: Total checks: 596, Successful checks: 584, Failed checks: 12, Internal errors: 0
  [yyyy-mm-dd hh:mm:ss] [INFO] check_domain:262: For more details, please, check:[[
          Failed guardrails YML: [/var/log/vmware/vcf/domainmanager/brownfield/###-###-###-###/output/guardrails_report_vcenter_fqdn.yml]
          Failed guardrails CSV: [/var/log/vmware/vcf/domainmanager/brownfield/###-###-###-###/output/guardrails_report_vcenter_fqdn.csv]
  All guardrails CSV: [/var/log/vmware/vcf/domainmanager/brownfield/###-###-###-###/output/guardrails_report_vcenter_fqdn_all.csv]
  
  [yyyy-mm-dd hh:mm:ss] [CRITICAL] vcf_brownfield:1002: Failed to sync domain vcf_domain 
  Traceback (most recent call last):
  File "/opt/vmware/vcf/domainmanager/scripts/vcf-import-tool/vcf_brownfield.py", line 979, in sync_domain
      sync_domain_result: list[str] = sync.sync_domain()
  File "/opt/vmware/vcf/domainmanager/scripts/vcf-import-tool/domain_sync/sync_domain.py", line 58, in sync_domain
      self.__run_guardrails(sso_remote_endpoint, domain_type, domain_id)
  File "/opt/vmware/vcf/domainmanager/scripts/vcf-import-tool/domain_sync/sync_domain.py", line 112, in __run_guardrails
      raise DomainSyncException(ErrorMessages.GUARDRAILS_SYNC_FAILURE_CRITICAL_FOR_DOMAIN.format(domain_id))
  common.common_exceptions.DomainSyncException: Could not proceed with sync operation since domain with Id: ###-###-###-### has failed guard rails. This would leave SDDC Manager in a unconforming state Retry the sync operation after fixing guard rails warnings.
  [yyyy-mm-dd hh:mm:ss] [INFO] vcf_brownfield:633: Operation sync completed on target: vcf_domain  with status: FAIL

• vcf_domain is the domain you are syncing and guardrails_report_vcenter_fqdn is the guardrail report for the vCenter server associated with this domain. 
  
  

 

Environment

VMware Cloud Foundation 9.x

Cause

VCF pre-checks are executed against the SDDC domain by the guardrail mechanism. All failing ERROR checks must be resolved.

Resolution

To resolve this issue, please complete the following steps:

1. Review the Guardrails Report: Locate and open the failed guardrails CSV file referenced in your logs. You can find it at this path:
   /var/log/vmware/vcf/domainmanager/brownfield/###-###-###-###/output/guardrails_report_vcenter_fqdn.csv
2. Review the specific errors detailed in the CSV file and manually correct them within your environment.
3. Once all reported errors have been addressed, re-run the Sync Inventory operation.