Error when creating new cluster on VKC 1.33 or 1.34 “Could not resolve KR/OSImage Multiple OSImages resolved for Control Plane.”

Products

• Tanzu Kubernetes Runtime

Issue/Introduction

Below issues are encountered when creating new cluster on 1.33 or 1.34, tried to edit the cluster image version and got the error message:





error: clusters.cluster.x-k8s.io "king-vks-demo" could not be patched: admission webhook "tkr-resolver-cluster-webhook.tanzu.vmware.com" denied the request: Could not resolve KR/OSImage
Multiple OSImages resolved for Control Plane. KR: v1.33.3---vmware.1-fips-vkr.1, OSImages resolved: [vmi-634c19c8d12682963 vmi-bc9f06e001900ded3], filters: {k8sVersionPrefix: v1.33.3+vmware.1-fips, osImageSelector: os-name=ubuntu}
Multiple OSImages resolved for MachineDeployment default. KR: v1.33.3---vmware.1-fips-vkr.1, OSImages resolved: [vmi-bc9f06e001900ded3 vmi-634c19c8d12682963], filters: {k8sVersionPrefix: v1.33.3+vmware.1-fips, osImageSelector: os-name=ubuntu}
You can run kubectl replace -f /tmp/kubectl-edit-2665630231.yaml to try this update again.

 

Environment

VKR(TKR) 1.33 or later

Resolution

We need to specify which os version in the cluster yaml, have to add an os-version to the annotation. Check the available ubuntu versions with "k get osimages"

Below is the annotation example: 

run.tanzu.vmware.com/resolve-os-image: os-name=ubuntu,os-version=24.04

Additional Information

 VMware vSphere Kubernetes Service Release Notes

Introducing VMware vSphere Kubernetes Service 3.4: Extended Kubernetes Support, Istio Service Mesh, and Enhanced Multi-Cluster Management - VMware Cloud Foundation (VCF) Blog