search cancel

SpectroSERVER high memory and crash

book

Article ID: 229693

calendar_today

Updated On:

Products

CA Spectrum

Issue/Introduction

high CPU leading to hung SS 
Pstacks show CsPort::prune_pconns_by_proximity()
Grafana shows CPU is periodic going from 100% idle to 100% in use and staying there for extended periods.

From pstack 

Thread 1 (Thread 0x7f8214802cc0 (LWP 13225)):
#0  0x00007f8208a8bf30 in CsULHashTableIter::is_edited () from /opt/SPECTRUM/lib/libGlobl.so.1
#1  0x00007f8208acbc3b in CsULHashTableIter::get_next(int, unsigned int*) () from /opt/SPECTRUM/lib/libGlobl.so.1
#2  0x00007f82138e4588 in CsPort::check_device(CsPort&) () from /opt/SPECTRUM/lib/../SS/libadcor.so.1
#3  0x00007f82138e448b in CsPort::check_port(CsPort&) () from /opt/SPECTRUM/lib/../SS/libadcor.so.1
#4  0x00007f82138e4577 in CsPort::check_device(CsPort&) () from /opt/SPECTRUM/lib/../SS/libadcor.so.1
#5  0x00007f82138e448b in CsPort::check_port(CsPort&) () from /opt/SPECTRUM/lib/../SS/libadcor.so.1
#6  0x00007f82138e4577 in CsPort::check_device(CsPort&) () from /opt/SPECTRUM/lib/../SS/libadcor.so.1
#7  0x00007f82138e448b in CsPort::check_port(CsPort&) () from /opt/SPECTRUM/lib/../SS/libadcor.so.1
#8  0x00007f82138e4577 in CsPort::check_device(CsPort&) () from /opt/SPECTRUM/lib/../SS/libadcor.so.1
#9  0x00007f82138e46b7 in CsPort::check_pconn(CsPort&, CsPort&, CsPorts const*) () from /opt/SPECTRUM/lib/../SS/libadcor.so.1
#10 0x00007f82138e7b79 in CsPort::prune_pconns_by_proximity() () from /opt/SPECTRUM/lib/../SS/libadcor.so.1
#11 0x00007f82138d97d8 in prune_pconns_wrapper(void*) () from /opt/SPECTRUM/lib/../SS/libadcor.so.1
#12 0x00007f8213d79211 in moot_thread_start () from /opt/SPECTRUM/lib/libmoot.so.1
#13 0x00007f8204896190 in ?? () from /lib64/libc.so.6
#14 0x0000000000000000 in ?? ()

Environment

Release : 21.2

Component : Spectrum Discovery & Modeling

Cause

ADisc found too many potential connections for layer2 discovery. During the pruning process, it went through a busy loop. 

Resolution

21.02.02.D28 has been created for this issue. It will improve the code to let the thread schedule.


    REQUIREMENTS

        SPECTRUM 21.02.00 and 21.02.02 are the prerequisites for installation of this patch.

 This patch needs to be installed on SpectroSERVER.

    OVERVIEW 

        This is a Debug patch for the following issue:

 DE521619 Details:
   32909937: High CPU caued by auto discovery.
  (DE521619, 32909937)

    
   BILL OF MATERIALS
 
 ReleaseNote.D28.txt 
 runme (Linux)
 uninstall_D28.pl (Linux)
  libadcor.so.1 (Linux)
  libadisc.so.1 (Linux)
  libgnrtrss.so.1 (Linux)
  libvpn.so.1 (Linux)
  libwlc.so.1 (Linux)

Additional Information

Please contact support to get a copy of this patch.