Continuous Unhandled Error loading OpenAPI spec in kube-apiserver logs

Products

• VMware vSphere Kubernetes Service

Issue/Introduction

In VMware vSphere Kubernetes Service (VKS) environments, the kube-apiserver on Supervisor and VKS clusters generates continuous unexpected error messages in the logs.
The following error patterns are continuously recorded in the kube-apiserver logs:

E0409 hh:mm:ss.xxxxxx 1 controller.go:146] "Unhandled Error" err="Error updating APIService \"v1alpha1.data.packaging.carvel.dev\" with err: failed to download v1alpha1.data.packaging.carvel.dev: resource not found" logger="UnhandledError"

E0409 hh:mm:ss.xxxxxx 1 controller.go:102] "Unhandled Error" err="loading OpenAPI spec for \"v1alpha1.data.packaging.carvel.dev\" failed with: failed to download v1alpha1.data.packaging.carvel.dev: resource not found" logger="UnhandledError"

I0409 hh:mm:ss.xxxxxx 1 controller.go:109] OpenAPI AggregationController: action for item v1alpha1.data.packaging.carvel.dev: Rate Limited Requeue.

Environment

vSphere Kubernetes Service 3.5.x

Cause

This issue is caused by an interoperability mismatch where kube-apiserver attempts to fetch specifications using both OpenAPI v2 and v3, but the deployed kapp-controller fails to expose the OpenAPI v2 specification.

Resolution

• Safely ignore these specific log entries in the current product version, as there is no actionable workaround to suppress them without impacting the environment.
• To permanently resolve this issue, upgrade to a future VKS release that integrates kapp-controller version v0.59.7 or later.
  This upstream release incorporates the necessary code modifications to correctly register the OpenAPI v2 specification.

For more details regarding the upstream fix, refer the carvel-dev/kapp-controller GitHub repository (Pull Request #1803).
Also refer to the VMware VKr Release Notes for information on forthcoming product releases containing updates in relation to this fix.

Additional Information

Japanese KB: kube-apiserverのログにOpenAPI specに関するUnhandled Errorが継続的に記録される