VCF Management Services 9.0 to 9.1 upgrade fails at Deploy Software Depot Component - VMware Cloud Foundation Automation (VCF Automation)

Products

• VCF Automation

Issue/Introduction

Introduction

During the upgrade of VMware Cloud Foundation (VCF) from version 9.0 to 9.1, the upgrade process fails during the "Deploy Software Depot Component" subtask. The deployment cannot proceed, and the following error is observed in the VCF UI:

Failed to stage component: "Platform Health Check. Status: FAILED Platform Health Check Error [platform-deployments-core : 1 of 33 resources are not ok: support-bundle-logcopier-event-tailer: wrong resource state: InProgress - Available: 0/1;] [VCFMS-HEALTH-002]"

Symptoms

• The upgrade hangs or fails at the "Deploy Software Depot Component" phase.
• Kubernetes pods related to support-bundle-logcopier-event-tailer enter a CrashLoopBackOff state.
• Pod logs for support-bundle-logcopier-event-tailer indicate an error such as: "the disk image is malformed".

Environment

VCF Automation 9.0.x

VCF Automation 9.1.0

Cause

The support-bundle-logcopier-event-tailer pod is failing to successfully pull the required container image for the database, resulting in a corrupted or incomplete image state on the node.

Resolution

To resolve this issue, you must manually clear the incomplete image and trigger a new pull of the necessary container images.

1. Access the Node: SSH into the appropriate controlplane node using vmware-system-user credentials.

2. Elevate Privileges: Run sudo -i to switch to the root user.

3. Force Image Re-pull: Execute the following for loop to identify incomplete container images and perform a fresh pull:

   bash
   for
      img in $(ctr -n k8s.io images check | grep incomplete | awk '{print $1}'); do ctr -n k8s.io images pull -k $img
   done

    

4. Verify and Retry: Once the script completes, verify that the pods have stabilized. Return to the VCF Management UI and restart the "Deploy Software Depot Component" subtask.

Additional Information

Note: For defects and enhancements subscribe to the article to be updated on fix status.