SSH session timeout/accidently closed causes SD-WAN Gateway upgrade failed

Products

• VMware VeloCloud SD-WAN

Issue/Introduction

During the upgrade of the SD-WAN Gateway, SSH sessions to the SD-WAN Gateway sometimes experience timeouts or are accidentally closed by the customer. As a result, the upgrade procedure remains incomplete, which can lead to unexpected issues. The "_staging" folder and ".upgrade_lock*" files persist in the "/var/lib/velocloud/software_update" directory. Upon checking the "/var/log/vcg_software_update.log" file, it is evident that the upgrade procedure has been aborted. In a successful upgrade, you should see the message "VCG upgrade complete" at the end of the "vcg_software_update.log" file.

Environment

All VMware by Broadcom SD-WAN Gateway versions

Cause

SSH session timeout or closed by any reason

Resolution

1. Use Esxi console to run the command instead of SSH: https://techdocs.broadcom.com/us/en/vmware-cis/vsphere/vsphere/7-0/vsphere-virtual-machine-administration-guide-7-0.html
2. Some SSH terminal software has feature to keep SSH session always alive, for example PuTTY:

Xshell: