Notification synchronization issues between SAM layers

Products

• VMware Smart Assurance

Issue/Introduction

Symptoms:

• Notifications between the SAM layers appear to be out of sync.
• Users may run the following to confirm the ownership and acknowledgement status of the notifications:

dmctl -s <Pres-SAM> get ICS_Notification::<Insert Notification Name Here> | grep -iE "Owner|Ack"

dmctl -s <Agg-SAM> get ICS_Notification::<Insert Notification Name Here> | grep -iE "Owner|Ack"

• If any of the notifications exhibit out of sync behavior on the above parameters, this would mean that the Notifications could be dropped by the Notification List. 

Environment

Smarts 10.X , 24.3.X

Cause

The Default Notification List is configured to filter out the Notifications owned by the SYSTEM user.

This issue may appear on an event of disconnect of domains (in the following sequence)

CLEAR AGG → CLEAR PRES → Domain Disconnect → NOTIFY AGG → UNACK AGG → Reconnect → NOTIFY PRES 

Resolution

Please get in touch with the Broadcom Support as this may require an in-depth analysis on the affected notifications and reconciling the ownership status back to the original status accordingly.