Spectrum alarms correlation with OI is not working. SPD is unable to reconcile alarms correctly if SpectrumServer runs in HA mode.
The alarm match could be corrected only by removing a field from DataPublisher but still some alarms closed on DX platfom are not being cleared from Spectrum.
This scenario can be observed when Spectro Servers are running in HA mode. When Spectro server restarts alarms are created. While switching secondary SS server and after 2 minutes primary SS should be up. After such SS failover alarms will be cleared from spectrum but can still remain on DX.
DX OI 21.3.1
Spectrum 21.2.4
Spectrum One-click 21.2.8.0.32
SDP 21.2.8.0
Currently Spectrum Data Publisher (SPUB) fetches the Alarms/NCM/Topology data from OneClick server and pushes to OI. Please refer the diagram below.
SPUB don’t maintain the SpectroServer (SS) status to decide whether to push this data to OI.
There is an enhancement request currently under consideration by our Product Management team. As part of this enhancement, SPUB will leverage heartbeat API to know the SS state (up/down/switchover) and decide accordingly to retain the alarm push of the particular SS which is down.
WORKAROUND:
Only the restart of the Data publisher can help to sync the alarms in this scenario.
The following KBs can also be useful when troubleshooting other similar issues in general:
DX OI 21.3.1 - Missing Alarms updates from Spectrum 21.2.4
https://knowledge.broadcom.com/external/article/229910
Troubleshooting SpectroSERVER
https://techdocs.broadcom.com/us/en/ca-enterprise-software/it-operations-management/spectrum/10-2/administrating/distributed-spectroserver-administration/troubleshooting-spectroserver.html
DX NETOPS SPECTRUM - 10.4.2 Topology View
https://techdocs.broadcom.com/us/en/ca-enterprise-software/it-operations-management/spectrum/10-4-2/managing-systems/virtual-host-manager/install-virtual-host-manager/viewing-the-virtual-environment/locating-virtual-models-in-ca-spectrum/topology-view.html
DX OI 21.3.1 - Spectrum Data Publisher registration fails with OIUrl FAILED
https://knowledge.broadcom.com/external/article/229473/dx-oi-2131-spectrum-data-publisher-regi.html
Troubleshooting SpectrumDataPublisher
https://techdocs.broadcom.com/us/en/ca-enterprise-software/it-operations-management/spectrum/21-2/integrating/integrate-ca-spectrum-with-ca-digital-operational-intelligence-using-spectrum-data-publisher.html#concept.dita_01d23b21ebdeb3555223a11e764ef8c41f86b5f7_TroubleshootingSpectrumDataPublisher
Integrate CA Spectrum with CA Digital Operational Intelligence Using Spectrum Data Publisher
https://techdocs.broadcom.com/us/en/ca-enterprise-software/it-operations-management/spectrum/10-3/integrating/ca-spectrum-and-analytics/integrate-ca-spectrum-with-ca-digital-operational-intelligence-using-spectrum-data-publisher.html#concept.dita_f69dc11148b5cf8d376565e51b6d0e18404f30a5_TroubleshootingSpectrumDataPublisher
AIOPs - Troubleshooting, Common Issues and Best Practices
https://knowledge.broadcom.com/external/article/190815/aiops-troubleshooting-common-issues-and.html#mcetoc_1f7qcopf91ue