Aria Operations 8.x
You may have configured test webhook notification rules incorrectly to send on 'All Statuses' which would include cancelled alerts and these rules are still set to Activated. If there is a cluster restart and there are older alerts that have not been acknowledged, they may get cancelled automatically, causing the alert webhook notifications to trigger once the cluster is back online.