Slow Job Queues following SOI high alert event or restart

Products

• CA Service Operations Insight (SOI)

Issue/Introduction

We have been experiencing an issue with our job queues in SOI. This is not affecting all of our job queues, but mostly alerts coming from our SCOM connector and one of our Spectrum connectors.

This happens after either a large alert storm due to a network event, or often after a complete SOI restart. The queues, especially off of our SCOM connector, will freeze. Randomly, sometimes once an hour, a large group of jobs in the queue will process. The result is that it will often take several hours for 1000 or less items in the queue to complete.

 

Environment

Release : 4.2

Resolution

We review the env, customer is running SOI 4.2 CU3

We reviewed the SOI Database, it looks like they will need to use the soitoolbox utility to start cleaning out old data since the oldest alert was from 2020.

 

I provided the following links to the soitoolbox

https://techdocs.broadcom.com/us/en/ca-enterprise-software/it-operations-management/service-operations-insight/4-2/administrating/database-maintenance/ca-soi-toolbox-utility.html

 

https://techdocs.broadcom.com/us/en/ca-enterprise-software/it-operations-management/service-operations-insight/4-2/administrating/database-maintenance/how-to-clean-up-data-with-the-ca-soi-toolbox.html

 

Customer will need to setup a time to cleanup the DB