High CPU usage on TCA Worker Nodes due to excessive API requests from Application Pods

Products

• VMware Telco Cloud Automation

Issue/Introduction

• High CPU usage is observed on Kubernetes Worker Nodes or the Management Cluster in the VMware Telco Cloud Automation (TCA) environment.
•  vCenter Server Performance charts show sustained CPU spikes on the Virtual Machines hosting the Kubernetes nodes.
• The Kubernetes API server logs indicate an abnormally high volume of API requests (e.g., 20,000+ requests in a short window) originating from specific application service accounts.
• Kube-apiserver pod is consuming a lot of CPU which normally should at only around ~100m

Environment

TCA 3.2
TKG 2.5.2

Cause

The volume of API calls generated by the application pods exceeds the system's handling capability.

Resolution

The issue originates in the 3rd-party application logic so resolution requires an application-level patch or configuration change. A support request should be raised with the Application Vendor (CNF provider).