VAMI backup including the supervisor control plane VMs fails.

Products

• VMware vCenter Server

Issue/Introduction

- VAMI backup with the option supervisor control plane VMs selected causes the backup to fail with an error.

- The /var/log/vmware/applmgmt/backup.log on the vCenter shows the following error:

ERROR: BackupManager encountered an exception: Hit exception inside process ComponentScriptsBackup

- The /var/log/vmware/wcp/wcpsvc.log on the vCenter shows the following error:

Error: failed to download file /wcp/backup/images.tar to VC. Error: net/http: request canceled (Client.Timeout or context cancellation while reading body)

Environment

vCenter 9.0.1

vSphere Kubernetes Service

Cause

- The issue occurs because of a timeout where it takes more than 10 mins which is the default timeout value to download the backup (images.tar) files from supervisor control plane VM.

 

Resolution

Increase the backup download timeout:

1. SSH into the VCSA and edit the WCP config file:
ssh root@<vc-ip>

# edit the config file
vi /etc/vmware/wcp/wcpsvc.yaml

2. Add this under the "clusterconfig:" block in the wcpsvc.yaml:

clusterconfig:
  # ... existing entries ....
  # .......
  # etcd_backup_timeout:              <---- add below this line 
  backup_download_timeout: 1800


3. Restart the WCP service on the vCenter:

vmon-cli --restart wcp


4. Run the VAMI backup with the supervisor control plane VMs option selected to confirm it now completes.