VMware Cloud Foundation: vCenter upgrade failed with VCENTER_UPGRADE_SET_REPO_FAILED

Products

• VMware Cloud Foundation

Issue/Introduction

• vCenter upgrade fails at VCENTER_UPGRADE_SET_REPO_FAILED stage.

• Fails with error https://<sddc-manager-fqdn>:/vmware/vcf/bundle/<bundle-id>/update_repo during upgrade for vCenter <vcenter-hostname> due to exception NotFound (com.vmware.vapi.std.errors.not_found) => { errorType = NOT_FOUND }.

Environment

• VMware Cloud Foundation 4.0.x
• VMware Cloud Foundation 5.0
• VMware Cloud Foundation 4.5

Cause

The /nfs/vmware/vcf/nfs-mount/bundle/ does not have proper permissions hence https://<sddc-manager-ip>/vmware/vcf/bundle/<bundle-Id>/update_repo returns 403 forbidden error code.

Resolution

This issue is fixed in VMware Cloud Foundation 4.5.1 and 5.1 release. A pre-check is added to check the permissions for the path /nfs/vmware/vcf/nfs-mount/bundle/

Refer Improvements to upgrade prechecks under What's new in Release notes
VMware Cloud Foundation 4.5 Release Notes

Workaround:

To workaround the issue,

• Update the permission of the directory /nfs/vmware/vcf/nfs-mount/bundle/ to 775.

Follow the steps below to update the permission:

1. SSH to the SDDC-Manager VM (eg: ssh vcf@<SDDC-Manager-IP>) as vcf user and su to root.
2. Update the directory permissions:

      chmod -R 775 /nfs/vmware/vcf/nfs-mount/bundle/