Spectrum server starts, after 20 minutes it again stopped, process terminated.

book

Article ID: 212094

calendar_today

Updated On:

Products

CA Spectrum

Issue/Introduction

SpectroSERVER crashing after around 20 minutes. Both primary and secondary.

The crash started yesterday (02/24/2021) at around 04:40 PM BRT when there was a power outage on the devices. Spectrum machines were not affected by this power outage as they are in a datacenter.

If the SSdb from 02/23/2021 is restored, the SS crashes after around 20 minutes

If the SSdb from last month is restored, the SS crashes after a few hours.

Spectrum 10.4.2.0.189 in Linux

(gdb) where
#0  0x00007fb830341a71 in HpH3cIRFAppIH::findChassisRole(CsOIDValue*, CsOIDValueList, CsOIDValueList) () from /app/Spectrum/SS/Modules/libhph3c.so.1
#1  0x00007fb830342980 in HpH3cIRFAppIH::populate_chassis_attrs(CsModelHandle const&) () from /app/Spectrum/SS/Modules/libhph3c.so.1
#2  0x00007fb863bb845b in CsIHTimerMgr::do_periodic_work(CsPeriodicWorkNode const*) () from /opt/SPECTRUM/lib/../SS/libsskrnl.so.1
#3  0x00007fb85eb4ef0b in CsPeriodicWorkScheduler::process_work_node(CsWorkNode*) () from /opt/SPECTRUM/lib/libwkmgr.so.1
#4  0x00007fb85eb4fa70 in CsWorkScheduler::do_work() () from /opt/SPECTRUM/lib/libwkmgr.so.1
#5  0x00007fb863891211 in moot_thread_start () from /opt/SPECTRUM/lib/libmoot.so.1
#6  0x00007fb857915d40 in ?? () from /lib64/libc.so.6
#7  0x0000000000000000 in ?? ()

Environment

Release : 20.2

Component : Spectrum Core / SpectroSERVER

Resolution

Open a support case and request the Spectrum_10.04.02.D134.Linux.txe debug patch.

See the ReleaseNote.D134.txt file.

Here are the steps:

1. Shutdown the SpectroSERVER and processd (Spectrum Process Daemon)

2. Restore the $SPECROOT/SS/Modules/libhph3c.so.1 file, that was moved to a temporary directory.

3. Apply Spectrum_10.04.02.D134.Linux.txe patch by running it.

As best practices copy the Spectrum_10.04.02.D134.Linux.txe and ReleaseNote.D134.txt files to the following directory structure to preserve the original files in case you want to uninstall the patch:

$SPECROOT/Patches/Spectrum_10.04.02.D134

          -For Linux:

            - Save "Spectrum_10.04.02.D134.Linux.txe" in a directory
              of your choice.

            - Type: "chmod 755 Spectrum_10.04.02.D134.Linux.txe" to
              change the permissions of the file.

            - "./Spectrum_10.04.02.D134.Linux.txe"

 

4. Start the processd and then start the SpectroSERVER.