SOI Server is using almost all the available CPU for java processes

Products

• CA Service Operations Insight (SOI)

Issue/Introduction

We have noticed that in the last couple days the SOI admin server is hitting 97 to 100% CPU utilization and sustaining that level for extended periods of time.  We had to reboot it last night to get it to release the CPU.  Today it has headed back up to nearly 100% and we are concerned that it is an issue that needs to be addressed soon so it doesn't get worse.

Environment

Release : 4.2

Component : Service Operations Insight (SOI) Manager

Resolution

The high CPU java process is from the SOI Application Server service.

The CPU usage is going up and down, I review the soi manager log file and didn't see any critical error.  Memory usage was only 3.7GB and set for 6GB.

 

We did notice there's been higher alerts from one of the Spectrum landscape, it was sending 5-10 alerts (update, delete, new) every 1 second.  

 

Customer added a couple CPUs to the server and it seem stable.