Excessive Traps Causing Spectrum Performance Issues

Products

• Spectrum

Issue/Introduction

Excessive traps causing SpectroSERVER to use 90%+ CPU constantly.

This results in slow SpectroSERVER performance seen in OneClick or causes the landscape to show red in OneClick.

Environment

Release: Any
Component: SPCCSS

Cause

Excessive traps can cause the SpectroSERVER to consume high CPU and memory resulting In Spectrum hanging in OneClick.

In addition, if the excessive traps are processed through a Southound Gateway integration, it will have an even greater impact on the SpectroSERVER performance. 

To verify, use a sniffer on the SpectroSERVER system and sniff the trap port 162 to identify where these traps originate.

On Linux, you can run pstack on the SpectroSERVER process id. Run pstack every few seconds for at least a minute, piping the  results to a file. For example:

pstack 12345 >> pstack.out

Review the output file and examine Thread 1 for each pstack command run. Thread 1 may show Spectrum processing traps/alerts or processing Events through Southbound Gateway.

Resolution

This issue needs to be addressed at the source sending the traps.