"Failed to create NSX resource for DLB Service" is seen in VKS (vSphere Kubernetes Service) when creating a new cluster

Products

• VMware NSX

Issue/Introduction

• In the VKS NCP (NSX Container Plugin) the following errors are seen:

errorCode="NCP00052"] nsx_ujo.ncp.nsx.policy.nsxapi create_lb_pool failed, cause: LBPool ID domain-c###:########-2545-4ade-82cd-######## was not realized after 60 attempts with 1.0 seconds sleep
errorCode="NCP00052"] nsx_ujo.ncp.nsx.lb_layer4_service Failed to create loadbalancer pool for with tags ... was not realized after 60 attempts with 1.0 seconds sleep

• In the NSX manager logs /var/log/proton/nsxapi.log you can see the following:

Category: SMALL :: Total weight: 0, Max capacity: 0, Current occupied weight: 0, holds leadership for services: {}
Category: MEDIUM :: Total weight: 0, Max capacity: 0, Current occupied weight: 0, holds leadership for services: {}
Category: LARGE :: Total weight: 0, Max capacity: 0, Current occupied weight: 0, holds leadership for services: {}

Environment

VMware NSX

VKS

Resolution

There is an issue with the manager service losing leadership, which can lead to realization issues with NSX.

Please review the following KB for details and workaround:

Objects in NSX UI are stuck "In Progress"

If this does not resolve your issue, please review the following KB in regards JDK issue which can impact the NSX manager nodes:

NSX is Impacted by JDK-8330017: ForkJoinPool Stops Executing Tasks Due to ctl Field Release Count (RC) Overflow