Error: "NSX-T Manager is in error state due to audit failure. Please run upgrade pre-checks before proceeding with upgrade." in SDDC Manager

Products

• VMware SDDC Manager

Issue/Introduction

Potential Issues with NSX Managers:

While working with NSX Managers, you may encounter the following issues:

Upon reviewing the NSX logs, you may notice a warning message similar to the following:

Log Warnings in /var/log/syslog: 
"New maximum of client API rate has exceeded 80% of the allowed limit. Max = 87, client = <NSX-T account credentials>, limit = 100".
This log entry highlights that the client has reached or exceeded 80% of the allowed API rate limit, indicating a potential risk of hitting the maximum threshold.

Environment

NSX

Aria Operations

Resolution

In scenarios where the NSX Manager API rate limit is exceeded, it is typically due to an excessive number of API requests being made within a short time frame.

By default, NSX Manager supports up to 100 API calls per second for each manager node.

Steps:

Disable adapter on Aria Operations

Confirm logs are not showing excessive API calls in /var/run/syslog

Reboot NSX managers one at a time

Re-attempt upgrade from SDDC manager for NSX.