How to handle alarm_management.alarm_service_overloaded alarm in NSX Manager.

Products

• VMware NSX-T Data Center

Issue/Introduction

• Event ID: Alarm Service Overloaded

Alarm Description

• Purpose: The purpose of this alarm is to inform the user that the alarm service is temporarily overloaded due to heavy volume of alarms reported.
• Impact: The NSX UI and GET /api/v1/alarms NSX API have stopped reporting new alarms; however, syslog entries and SNMP traps (if enabled) are still being emitted, reporting the underlying event details.

Environment

VMware NSX-T Data Center

Cause

This event is triggered due to a heavy volume of alarms reported, the alarm service becomes temporarily overloaded

Resolution

This is a condition that may occur in a VMware NSX environment.

 

Note:  A maintenance window may be required for remediation of some alarms.

 

Workaround
For 3.0.0 and higher

 

• Review all active alarms using the Alarms page in the NSX UI or by running the following GET API call;
  • /api/v1/alarms?status=OPEN,ACKNOWLEDGED,SUPPRESSED NSX API.
• For each active alarm, investigate the root cause by following the recommended action for the alarm.
• When sufficient alarms are resolved, the alarm service will start reporting new alarms again.