Receiving many unexpected alerts or notifications on cancelled alerts
search cancel

Receiving many unexpected alerts or notifications on cancelled alerts

book

Article ID: 394056

calendar_today

Updated On:

Products

VMware vSphere ESXi

Issue/Introduction

  • You may receive hundreds of unexpected alerts or notifications within Aria Operations or another tool like Datadog and the alerts appear to be cancelled alerts only.
  • Getting more than 500+ alerts in the environment due to metric configuration

Environment

Aria Operations 8.x

Cause

You may have configured test webhook notification rules incorrectly to send on 'All Statuses' which would include cancelled alerts and these rules are still set to Activated. If there is a cluster restart and there are older alerts that have not been acknowledged, they may get cancelled automatically, causing the alert webhook notifications to trigger once the cluster is back online.

Resolution

  • Disable any duplicate notification rules that are not needed within Configurations > Notifications
  • Ensure that you are setting the 'Notify On: Select the Alert status change you want to receive notification on' value to New only within the notification configuration
  • Ensure you are managing your alerts within Aria Operations once they are being handled by a 3rd party tool

Additional Information