When attempting to create new alert definitions "Cannot Save alert. (400) Exceeded limit settings: <#> alerts allowed per customer" messages are received.
Cannot save alert. (400)
Exceeded limit setting: <#> alerts allowed per customer
Note: The log excerpts/Messages are only examples. Date, time, and environmental variables may vary depending on your environment.
This message means the tenant has reached its configured maximum for Alerts
It's recommended to review your tenant for alerts that are no longer needed. For example, alerts for obsolete sources, (Soft)Deleted Alerts, Snoozed Alerts including "Snoozed forever" or orphaned Alerts are counting against your tenant's limit.
Our REST API, available on all tenants, allows administrators to view current alerts and provide a summary view of each given including their current state.
Below is an example of the output from the API, that shows the states and number of alerts in each state.
REST API https://<<cluster>>.wavefront.com/api-docs/ui/#!/Alert/getAlertsSummary
{ "status": { "result": "OK", "message": "", "code": 200 },
"response":
{ "no_data_smoke": 0,
"checking": 1098,
"active_severe": 3,
"no_data_warn": 162,
"active_warn": 11,
"active": 15,
"no_data": 243,
"active_smoke": 1,
"snoozed": 33,
"affected_by_maintenance": 0,
"trash": 43,
"no_data_severe": 38,
"no_data_info": 23,
"active_info": 0,
"invalid": 0
}}
From the example output, there are several alerts that are in a "Snoozed" state and possibly 'Snoozed Forever' and in "Trash". Please review Wavefront documentation on Alert Lifecycles.
Continued alert maintenance, will ensure that the limits are rarely reached and that we are keeping only valid meaningful alerts in the system at all times.
It is highly encouraged for customers that perform alert creation via automation to periodically perform alert review and maintenance to ensure only viable alerts are maintained in the system at all times.
The inability to create a new alert definition can be limited due to alert limits instituted for all customers. These limits allow for the tenant to be optimally managed. While limits may be increased on a case-by-case basis, it is The alert limit is calculated with consideration to all alerts in all states to give us on overall value for the total alerts present.
If your current Alerting needs have grown, or you're projecting an increase in needed Alerts, please open a support ticket so that our Engineers can work with you to increase your configured maximum.
Create and Manage Alerts See Sections at the bottom "Restore a Deleted Alert" for finding Deleted Alerts
Alert States and Lifecycle See Section: Viewing Firing Alerts