Error: Applying system update stuck In Progress during VCF Operations 9.1 upgrade

Products

• VCF Operations/Automation (formerly VMware Aria Suite)

Issue/Introduction

Symptoms

• While running upgrade prechecks VCF Operations from version 9.1.0.0100 to 9.1.0.0200, the "Applying System Update" precheck subtask remains stuck in "In Progress" status for several hours or indefinitely.
• SDDC Manager domainmanager.log shows continuous polling of the Operations task without state change.

Environment

VCF 9.1

VCF Operations 9.1

SDDC Manager 9.1

Cause

This issue occurs when a duplicate Aria Patching and Upgrade Automation Tool (APUAT) upgrade task is initiated before the original process has finished. The duplicate task inherits the taskID of the original. While the actual task may have completed on the original thread, the duplicate task remains active with no remaining work to perform, causing the SDDC Manager to remain in a polling state.

Resolution

Fixed in release 9.1.0.0200 and higher. See Download Broadcom Products and Software to download this release.

 

Take a snapshot of all VCF Operations nodes before making file modifications

Manually update the APUAT results file to reflect a completed state, which allows the SDDC Manager to recognize the task as finished:

1. Log in to the VCF Operations primary node via SSH.
2. Locate and back up the original APUAT results JSON file. Ex:  cp /storage/db/pakRepoLocal/APUAT-xxx.results /storage/db/pakRepoLocal/bak-APUAT-xxx.results.bak
3. Edit the file and locate the following keys, updating their values as shown below:
   

     BEFORE                                      →        AFTER

   "cleanup_exit_code": ""                      →     "cleanup_exit_code": "0"

   "cleanup_result": "no results"               →     "cleanup_result": "Completed successfully"

   "apply_system_update_exit_code": ""          →     "apply_system_update_exit_code": "0"

   "apply_system_update_result": "Running"      →     "apply_system_update_result": "Completed successfully"

4. Save the file.
5. Return to the SDDC Manager UI. The task should now move to a completed state, allowing you to proceed with subsequent lifecycle operations.

Additional Information

VCF Operations 9.1.0.0200 Release Notes

Download Broadcom products, patches and software