Supervisor Cluster Deployment Stalls During "Configured Core Supervisor Services"

Products

• Tanzu Kubernetes Runtime

Issue/Introduction

During the deployment of a new vSphere with Tanzu or TKGs deployment, the cluster stalls at Configured Core Supervisor Services with the messages below:

Service: tkg.vspherevmware.com. Reason: ReconcileFailed. Message: Expected to find at least one version, but did not (details:all=1 -> after-prereleases-filter=1 -> after-kubernetes-version-check=1 -> after-kapp-controller-version-check=1 -> after-constraints-filter=0).

Service: velero.vspherevmware.com. Reason: ReconcileFailed. Message: Expected to find at least one version, but did not (details:all=0 -> after-prereleases-filter=0 -> after-kubernetes-version-check=0 -> after-kapp-controller-version-check=0 -> after-constraints-filter=0).


There may be log entries vCenter appliance wcpsvc.log similar to the following:

2024-10-18T16:07:00.734Z error wcp [vclib/guestop_manager.go:54] [opID=xxxxxxxx-xxxxxxxx-xxxx-xxxxx-xxxxx-xxxxxxxxxxx-vm-xxxxxx] Guest operation failed with err ServerFaultCode: File /etc/vmware/wcp/.node_configuration_status was not found
2024-10-18T16:07:00.734Z info wcp [vclib/guestop_manager.go:57] [opID=xxxxxxxx-xxxxxxxx-xxxx-xxxxx-xxxxx-xxxxxxxxxxx-vm-xxxxxx] Guest operation failure is not retriable.
2024-10-18T16:07:00.734Z debug wcp [kubelifecycle/master_node_bootstrap.go:189] [opID=xxxxxxxx-xxxxxxxx-xxxx-xxxxx-xxxxx-xxxxxxxxxxx-vm-xxxxxx] Supervisor node bootstrap configure operation is still in progress.
2024-10-18T16:07:02.047Z error wcp [vclib/guestop_manager.go:54] [opID=xxxxxxxx-xxxxxxxx-xxxx-xxxxx-xxxxx-xxxxxxxxxxx-vm-xxxxxx] Guest operation failed with err ServerFaultCode: File /etc/vmware/wcp/.node_configuration_status was not found

Environment

VMware vCenter Server Version: 8.0.3
VMware Tanzu Supervisor Services: 3.0.0

Resolution

As a workaround, the WCP service may be restarted. 
The deployment will continue and will need to be monitored until it succeeds. 

Additional Information

See Additional KBs for similar issues:
Post upgrade, Supervisor stuck in "Configuring" because it cannot configure the Core Supervisor Services.