NSX Management Pack generates a large number of API calls to NSX

Products

• VCF Operations/Automation (formerly VMware Aria Suite)

Issue/Introduction

• Too many API calls from Aria Operations to NSX.
• NSX is reporting alarms for Client API limit has exceeded the allowed limit.
• /var/log/syslog on the NSX Manager will contain messages similar to the following:

  YYYY-MM-DDTHH:MM:SS.###Z <NSX_node_name> NSX ##### - [nsx@#### comp="nsx-manager" level="WARNING" subcomp="http"] New maximum of client API rate has exceeded 80% of the allowed limit. Max = 87, client = <aria _operations-service_user>, limit = 100

• The following built-in NSX content pack alert for Aria Operations for Logs has triggered,
  Name: ApiRateLimit
  Description: Client API reached 80% of the configured threshold.

Environment

Aria Operations 8.x

Aria Operations 9.x

Resolution

This API handling limitation is known with NSX and is present by design for security reasons.

 

The same can be worked around considering the available resources in NSX cluster. Please be sure to be understand the impact of this change.

 

Workaround:

 

There is a client API limit parameter that can be modified in the configuration file for the NSX-T adapter to restrict the amount of client API calls being made.

1. Log into the Primary node as root via SSH or Console.
2. Open /usr/lib/vmware-vcops/user/plugins/inbound/NSXTAdapter3/conf/NSXT.properties in a text editor.
3. Find and edit the value of CLIENT_API_RATE_LIMIT
   Note: By default, this value is 70. It can be modified to any acceptable value. (For example: CLIENT_API_RATE_LIMIT=30)(The limit is different for different versions).
4. Save and close the file.
5. Repeat steps 1-4 on all other nodes in the Aria Operations cluster.

NOTE : If the above does not resolve the issue we can reduce the retry count from 5 to 1 to reduce the retry attempts. 

Additional Information

Japanese KB: NSX Management PackがNSXに対して大量のAPIコールを生成する