TKGI cluster upgrade failed with addon errand

Products

• VMware Tanzu Kubernetes Grid Integrated Edition

Issue/Introduction

You will notice below error while upgrading the TKGI clusters

Last Action Description:  Instance update failed: There was a problem completing your request. Please contact your operations team providing the following information: service: p.pks, service-instance-guid: 3xxxxx-4455-4ttt-836f-54ye4uu6fe67, broker-request-id: c22e222e-4dbf-4665-9c77-17764ef30f3d, task-id: 823333, operation: update, error-message: 0 succeeded, 1 errored, 0 canceled

 

 

Debug task shows below error

gatekeeper pod is failing in the cluster

Environment

TKGI

Cause

This is due to Mutating webhooks configuration in the cluster

kubectl get MutatingAdmissionWebhook -A

Resolution

Reduce the replica of the webhooks to 0, then retry the upgrade.