SDDC Manager upgrade fails with error message failed to SSH into vCenter using root credentials in isolated workload domains.

Products

• VCF Operations/Automation (formerly VMware Aria Suite)

Issue/Introduction

During SDDC Manager upgrade in a VCF 9.1 environment where vCenter instances of management and workload domains are not linked and have dedicated Single Sign-On, when attempting to establish an SSH connection to a management vCenter instance, the upgrade process might fail with the following error message: Failed to SSH into VCenter using root credentials even when credentials are correct and SSH access is properly configured.

Environment

VMware Cloud Foundation 9.1 

Cause

In isolated workload domains, SDDC Manager may get the Workload SSO while trying to connect to the Management SSO and can lead to connection failures. 

Resolution

1. SSH to the SDDC manager with the vcf user and then elevate to root with su
   
   
2. Edit the following file: vi /opt/vmware/vcf/lcm/lcm-app/conf/application-prod.properties
   
   
3. Add or change lcm.vcenter.ssh.precheck=false 
   
   
4. Exit and save the file: ESC :wq!
   
   
5. Restart all services.
   
   /opt/vmware/vcf/operationsmanager/scripts/cli/sddcmanager_restart_services.sh
   
   
6. Re-trigger SDDC Manager Upgrade.

Additional Information

VCF 9.2 Release notes known issues: https://techdocs.broadcom.com/us/en/vmware-cis/vcf/vcf-9-0-and-later/9-1/release-notes/vmware-cloud-foundation-9-1-0-0-release-notes/known-issues/vcf-installer-91-known-issues.html