SDDC Backup fails with Error: Workflow stopped due to application failure

Products

• VMware SDDC Manager

Issue/Introduction

SDDC UI reports backup failure with Error- Workflow stopped due to application failure.

The backup failures sub-sequent tasks also report- "Fetching task info..."

operationsmanager.log (Reports evets Failed to retrieve backup workflow and multiple Fetching workflow status)
####-##-##:##:##.##+0000 INFO  [vcf_om,6864d7b0d2881707ee1e4ca84#######,d4f8] [c.v.v.b.helper.SosBackupApiClient,http-nio-###.0.0.1-7300-exec-8] Fetching workflow status with id 461f3dee-5fb3--####--b3e8-c6276de43ed2
####-##-##:##:##.##+0000 INFO  [vcf_om,6864d7b08e25cbd5576c31e74#######,1281] [c.v.v.b.helper.SosBackupApiClient,http-nio-###.0.0.1-7300-exec-5] Fetching workflow status with id 90fece80-ab52--####--b00e-d7761221f951
####-##-##:##:##.##+0000 INFO  [vcf_om,6864d7b0ad71292c6932b69d9#######,fec6] [c.v.v.b.helper.SosBackupApiClient,http-nio-###.0.0.1-7300-exec-1] Fetching workflow status with id 280fddf5-b34e--####--82cb-efa9f8b77316
####-##-##:##:##.##+0000 INFO  [vcf_om,6864d7b0b8acb1a0aebf9fa27b#######,f680] [c.v.v.b.helper.SosBackupApiClient,http-nio-###.0.0.1-7300-exec-10] Fetching workflow status with id 64d9c4da-2fbf-####-8abe-ed394045bb27
####-##-##:##:##.##+0000 INFO  [vcf_om,6864d7b0acea1eb5f8ea65fe3f#######,6667] [c.v.v.b.helper.SosBackupApiClient,http-nio-###.0.0.1-7300-exec-2] Fetching workflow status with id 60014614-faab--####--9a2a-baa97ca254ed
####-##-##:##:##.##+0000 ERROR [vcf_om,6864d84d97afc2655ff#######,bb4f] [c.v.v.i.b.i.TranslationMessage,http-nio-###.0.0.1-7300-exec-3] Can't find resource for bundle java.util.PropertyResourceBundle, key GET_BACKUP_FAILED_INVALID_ID.remedy
####-##-##:##:##.##+0000 DEBUG [vcf_om,6864d84d97afc2655ff#######,,bb4f] [c.v.e.s.e.h.LocalizableRuntimeExceptionHandler,http-nio-127.0.0.1-7300-exec-3] Handler Error Response: {"errorCode":"GET_BACKUP_FAILED_INVALID_ID","arguments":[],"message":"Failed to retrieve backup workflow, invalid id","referenceToken":"LI5FEH"}
####-##-##:##:##.##+0000 INFO  [vcf_om,6864d84d753e44980a8c#######,,0ef5] [c.v.v.b.helper.SosBackupApiClient,http-nio-###.0.0.1-7300-exec-2] Fetching workflow status with id 461f3dee-5fb3-40ad-#######,-c6276de43ed2
####-##-##:##:##.##+0000 ERROR [vcf_om,6864d84d753e44980a8c#######,,0ef5] [c.v.v.b.helper.SosBackupApiClient,http-nio-###.0.0.1-7300-exec-2] Failed to get backup workflow. 410 GONE: "{"message":"Id: 461f3dee-5fb3-40ad-#######,-c6276de43ed2 doesn't exist"}<EOL>"
####-##-##:##:##.##+0000 DEBUG [vcf_om,6864d84d753e44980a8c#######,,0ef5] [c.v.e.s.e.h.LocalizableRuntimeExceptionHandler,http-nio-###.0.0.1-7300-exec-2] Processing localizable exception Failed to retrieve backup workflow, invalid id
####-##-##:##:##.##+0000 ERROR [vcf_om,6864d84d753e44980a8c#######,,0ef5] [c.v.e.s.e.h.LocalizableRuntimeExceptionHandler,http-nio-###.0.0.1-7300-exec-2] [#######,] GET_BACKUP_FAILED_INVALID_ID Failed to retrieve backup workflow, invalid id
com.vmware.evo.sddc.common.core.error.InvalidInputException: Failed to retrieve backup workflow, invalid id

 

Environment

VMware Cloud Foundation

Cause

This occurs because of SDDC Manager database consists of failed/stale 'SDDCMANAGER_BACKUP' events.

Resolution

The resolution requires clearing out database tables. Please contact Broadcom support  for assistance.