High API Call Latency Observed on NSX Manager

Products

• VMware NSX

Issue/Introduction

LSP tagging operations taking longer time (More than 30Sec)

Environment

VMware NSX-T Data Center

Cause

Proton invokes CCP through RPC to compute the effective group membership of the LSP when a UPM profile is attached to the port. Logical port operations initiate RPC calls only when ServiceConfig's are associated with that port. ServiceConfig objects can cause unnecessary RPC calls

The delay in logical port tagging, exceeding 30 seconds to complete, was identified as the root cause of the issue.

As part of 3.1.x to 3.2.x upgrade the service config are created for all the ports which were having IP Discovery profile attached (VIF / non-VIF)

Note: 
Currently for greenfield 4.2.x environment this problem will not be seen. 
This issue will be seen only when customer upgrade history has 3.1.x to 3.2.x.

Resolution

Removing service configs from non-VIF will stop the excessive RPC calls to the NSX Manager.

Please reach out to Broadcom support with the NSX manager support bundles to have the service configs removed.