Namespaces Cluster Upgrade Stuck at 50% Due to ESXi Spherelet VIB Mismatch
search cancel

Namespaces Cluster Upgrade Stuck at 50% Due to ESXi Spherelet VIB Mismatch

book

Article ID: 428072

calendar_today

Updated On:

Products

VMware vSphere Kubernetes Service

Issue/Introduction

  • After completing a VMware vCenter Server upgrade, the "namespaces cluster upgrade" task remains stuck at 50% during the "upgrade host step". This issue prevents the vSphere HA configuration from completing and blocks full Supervisor cluster functionality.
  • The following error is observed in the vCenter Tasks & Events: A general system error occurred: Solution specification in the image are incompatible with hosts '<HOSTNAME>'

Environment

  • VMware vCenter Server
  • VMware vSphere Kubernetes Service

Cause

The upgrade task stalls due to a version mismatch between the upgraded Supervisor control plane VMs and the underlying ESXi hosts, which are still running an older version of the spherelet VIB. vCenter Server is unable to automatically achieve uniform spherelet versioning across all cluster components.

Resolution

To resolve this issue, manually align the ESXi host spherelet VIBs with the upgraded Supervisor configuration:

  1. Ensure the target cluster is in a state capable of receiving updates. Any ESXi hosts currently in Maintenance Mode must be returned to active status.

  2. Verify the health of the vSphere High Availability (HA) service. If the service displays errors, navigate to the cluster's vSphere Availability settings and either remediate the service or toggle it off and back on to ensure the HA agent is ready for host transitions.

  3. Verify the ESXi host compliance against the configured Cluster Image.

  4. Proceed with a manual remediation of the non-compliant ESXi hosts to complete the pending spherelet VIB installation.