SSH session timeout/accidently closed causes SD-WAN Gateway upgrade failed

Products

• VMware VeloCloud SD-WAN

Issue/Introduction

During the upgrade of the SD-WAN Gateway, SSH sessions to the SD-WAN Gateway sometimes experience timeouts or are accidentally closed by the customer. As a result, the upgrade procedure remains incomplete, which can lead to unexpected issues. The "_staging" folder and ".upgrade_lock*" files persist in the "/var/lib/velocloud/software_update" directory. Upon checking the "/var/log/vcg_software_update.log" file, it is evident that the upgrade procedure has been aborted. In a successful upgrade, you should see the message "VCG upgrade complete" at the end of the "vcg_software_update.log" file.

Environment

All VMware by Broadcom SD-WAN Gateway versions

Cause

SSH session timeout or closed by any reason

Resolution

1. Use Esxi console to run the command instead of SSH: https://docs.vmware.com/en/VMware-vSphere/7.0/com.vmware.vsphere.vm_admin.doc/GUID-92986CAA-4FDE-4AA0-A9E9-084FF9E03323.html
2. Some SSH terminal software has feature to keep SSH session always alive, for example PuTTY:

Xshell: