Backup of vCenter Server fails at 95% with error "Backup job failed" related to rbd(Auto Deploy service)
search cancel

Backup of vCenter Server fails at 95% with error "Backup job failed" related to rbd(Auto Deploy service)

book

Article ID: 401996

calendar_today

Updated On:

Products

VMware vCenter Server VMware vCenter Server 8.0

Issue/Introduction

  • VAMI based backup of vCenter Server Appliance (VCSA) fails with the error "Backup job failed"
  • Issue is seen during a Scheduled or Manual backup of VCSA
  • /var/log/vmware/applmgmt/backup.log:

YYYY-MM-DDTHH:MM:SS [<backup PID>] [ComponentScriptsBackup:PID-33516] [ComponentScripts::ComponentScriptsBackup:ComponentScripts.py:68] INFO: Starting backup component: rbd
YYYY-MM-DDTHH:MM:SS [<backup PID>] [ComponentScriptsBackup:PID-33516] [ComponentScripts::ComponentScriptsBackup:ComponentScripts.py:69] INFO: Execute rbd script: /etc/vmware/backup/component-scripts/rbd/rbd-backup-restore --startBackup
YYYY-MM-DDTHH:MM:SS [<backup PID>] [ComponentScriptsBackup:PID-33516] [ComponentScripts::ComponentScriptsBackup:ComponentScripts.py:76] INFO: Dispatching stream.
YYYY-MM-DDTHH:MM:SS  [<backup PID>] [ComponentScriptsBackup:PID-33516] [Log::run:Log.py:64] ERROR: Operation Failed: local variable 'baseDir' referenced before assignment
YYYY-MM-DDTHH:MM:SS  [<backup PID>] [ComponentScriptsBackup:PID-33516] [Proc::GetProcsStatus:Proc.py:361] ERROR: rc: 0, stderr: b'putting file - as <Backup Directory>bd.gz (0.2 kb/s) (average 0.2 kb/s)\n'
YYYY-MM-DDTHH:MM:SS  [<backup PID>] [ComponentScriptsBackup:PID-33516] [ComponentScripts::ComponentScriptsBackup:ComponentScripts.py:88] ERROR: Component backup command "/etc/vmware/backup/component-scripts/rbd/rbd-backup-restore --startBackup" failed 1.
YYYY-MM-DDTHH:MM:SS  [<backup PID>] [ComponentScriptsBackup:PID-33516] [ComponentScripts::ComponentScriptsBackup:ComponentScripts.py:115] ERROR: Error during component rbd backup
YYYY-MM-DDTHH:MM:SS [<backup PID>] [MainProcess:PID-33240] [Proc::VerifyProcStatusAndGetArchive:Proc.py:158] ERROR: Error at process ComponentScriptsBackup; rc:1.
YYYY-MM-DDTHH:MM:SS [<backup PID>] [MainProcess:PID-33240] [Proc::VerifyProcStatusAndGetArchive:Proc.py:162] ERROR: stderr:Error during component rbd backup
YYYY-MM-DDTHH:MM:SS [<backup PID>] [MainProcess:PID-33240] [Proc::VerifyProcStatusAndGetArchive:Proc.py:172] INFO: Following error message isn't localized:
  stderr:Error during component rbd backup
YYYY-MM-DDTHH:MM:SS [<backup PID>] [MainProcess:PID-33240] [BackupManager::main:BackupManager.py:592] ERROR: BackupManager encountered an exception: Hit exception inside process ComponentScriptsBackup:

  • Listing the directory on VCSA returns 0 directories

root@vcsa [ / ] # ls /storage/autodeploy/
total 0

Environment

VMware vCenter Server 7.0

VMware vCenter Server 8.0

Cause

The issue is caused as the backup of the rbd (Auto Deploy service) component failing due to missing directory on VCSA

Resolution

Log in to VCSA using ssh

Execute the below commands:

mkdir /storage/autodeploy/backup
ln -s /var/lib/rbd/backup/ /storage/autodeploy/backup

Restart the Appliance Management Service

service-control --restart applmgmt

Powered by Wolken Software