TKGi ingress creation pending at waiting for service IP

Products

• VMware Tanzu Kubernetes Grid Integrated Edition

Issue/Introduction

In the /var/vcap/sys/log/ncp/ncp.stdout.log on master node, you see the entries similar to:

nsx_ujo.ncp.k8s.ingress_lb_controller Ingress update workflow failed for ingress ('default', 'default-LB'): Unexpected error from backend manager (['NSXFQDN']) for LB Virtual server update: Failed to update virtual server
'httpStatus': 'BAD_REQUEST', 'error_code': 23704, 'module_name': 'LOAD-BALANCER', 'error_message': 'Exceed maximum number of pools on the Load balancer service. The maximum size of pools for SMALL load balancer service form factor is 60, current size of pools is 61.'

 

Environment

Tanzu Kubernetes Grid Integrated Edition (TKGi)

VMware NSX

Cause

This issue occurs when the server pool limit is exhausted on the TKGi cluster load balancer.
Configuration maximum depending on the size of the NSX edge can be seen at configmax.

Resolution

Create a new cluster with a Medium or Large LB with network profiles, per document,  and migrate workloads to the new cluster. 

If cluster creation is not possible, please open a support ticket.