How to debug the Event Manager Alarm subscription service.
This service retrieves the alarms from Spectrum for viewing in the Alarms views in the DX Netops Portal.
DX Netops Performance Management
1) Navigate to:
https://PORTALSERVER:8182/pc/center/admin/debug/servers/em/admin/config/logs?listing=all
Adjust the port and protocol (http/https) as needed. When not using https the default port is 8181.
2) Search in the page for:
com.ca.im.portal.em.spectrum.alarms.AlarmService
com.ca.im.portal.em.spectrum.alarms.utils.SpectrumRestUtils
com.ca.im.portal.em.spectrum.alarms.AlarmProcessingTask
Set these to TRACE using the dropdown on the right and click Update at the top or bottom pf the page.
Note if you don't see one or more of these, at the top of the page there is a place to enter them labeled "Category name:"
Enter the string as seen above, set the level to TRACE, and click ADD.
3) After setting the above, we can restart the alarm service as follows:
a) Get the XML for the current configuration.
curl -u admin -kv -X GET -H "Content-Type: application/xml" http://PORTALHOSTNAMEORIP:8281/EventManager/webservice/alarmservice/config > /tmp/config.txt
Adjust the port and protocol accordingly. When using https on the Event Manager the default port is 8282
Enter the admin web user password when prompted (this will be needed with each command)
b) In the resulting /tmp/config.txt find "<AlarmServiceConfig><Enabled>true</Enabled>" and change true to false.
c) Stop the alarm service by resending the updated XML:
curl -u admin -kv -X PUT -H "Content-Type: application/xml" -d'@/tmp/config.txt' http://PORTALHOSTNAMEORIP:8281/EventManager/webservice/alarmservice/config
You can verify success by rechecking the state:
curl -u admin -kv -X GET -H "Content-Type: application/xml" http://PORTALHOSTNAMEORIP:8281/EventManager/webservice/alarmservice/config
d) Wait for a minute or two.
e) Edit the /tmp/config.txt find "<AlarmServiceConfig><Enabled>false</Enabled>" and change false to true.
f) Re-enable the alarm service:
curl -u admin -kv -X PUT -H "Content-Type: application/xml" -d'@/tmp/config.txt' http://PORTALHOSTNAMEORIP:8281/EventManager/webservice/alarmservice/config
You can verify success by rechecking the state:
curl -u admin -kv -X GET -H "Content-Type: application/xml" http://PORTALHOSTNAMEORIP:8281/EventManager/webservice/alarmservice/config
4) Wait for the issue to be reproduced
5) Disable the debug by setting the entries changed in steps 1 and 2 to INHERITED and clicking update on the debug page as before
6) Collect the logging with
https://techdocs.broadcom.com/content/broadcom/techdocs/us/en/ca-enterprise-software/it-operations-management/performance-management/23-3/troubleshooting/unable-to-resolve-issue.html