SDDC manager backup fails with error "Package SDDC Manager backup operation failed"

Products

• VMware vCenter Server

Issue/Introduction

• Backup will fail on sub-task "Package and Encrypt SDDC Manager Backup" with error "Package SDDC Manager backup operation failed"

       

• SDDC manager contains errors similar to the excerpt below:
  
  /var/log/vmware/vcf/sddc-support/vcf-sos.log

  ERROR [vcf_sos] [commandutils.py::execute_cmd_locally::244::backup-048f2d76-6920-4624-9019-2059839f26f1] Std Error :  ; Command cd 
  /var/log/vmware/vcf/sddc-support/backup-[YYYY-MM-DDTHH:MM:SS]-2265; tar -zcvpf vcf-backup-vcf-sddc-hostname.com-[YYYY-MM-DDTHH:MM:SS].tar.gz.tmp 
  vcf-backup-vcf-sddc-hostname.com-[YYYY-MM-DDTHH:MM:SS]/* did not complete even after waiting for 120 seconds
  ERROR [vcf_sos] [backuphelper.py::package_sddc_mgr_backup::249::backup-048f2d76-6920-4624-9019-2059839f26f1] 
  Command execution failed : cd /var/log/vmware/vcf/sddc-support/backup-[YYYY-MM-DDTHH:MM:SS]-2265; tar -zcvpf vcf-backup-vcf-sddc-hostname.com-[YYYY-MM-DDTHH:MM:SS].tar.gz.tmp vcf-backup-vcf-sddc-hostname.com-[YYYY-MM-DDTHH:MM:SS]/*
  ERROR [vcf_sos] [backuphelper.py::package_sddc_mgr_backup::269::backup-048f2d76-6920-4624-9019-2059839f26f1] Package SDDC Manager backup operation failed
  ERROR [vcf_sos] [backuphelper.py::package_sddc_mgr_backup::271::backup-048f2d76-6920-4624-9019-2059839f26f1] Traceback (most recent call last):
  ERROR [vcf_sos] [backupservice.py::execute::78::backup-048f2d76-6920-4624-9019-2059839f26f1] Package SDDC Manager backup operation failed
  ERROR [vcf_sos] [backupservice.py::execute::79::backup-048f2d76-6920-4624-9019-2059839f26f1] SDDC Manager backup operation failed in task PackageSDDCManagerBackup.

Environment

VMware SDDC Manager 5.x

Cause

This issue can occur if a very large file, such as an old log bundle, resides in the VCF root partition. The backup process, which expects smaller configuration files, may time out after 120 seconds when attempting to compact very large files.

Resolution

The top 20 files consuming the most disk space need to be removed. Please contact Broadcom support for assistance in identifying and safely deleting these files.