SS crashed with core dumps while building Service Manager services or OC clients hang

book

Article ID: 194651

calendar_today

Updated On:

Products

CA Spectrum CA eHealth

Issue/Introduction

When building out Spectrum Service Manager Services, the SpectroSERVER crashed and the stack shows the following:

Program terminated with signal 11, Segmentation fault.
#0  0x00007fd823dabb00 in CsCoreIf::get_serv_id_prec_node(CsServiceIDInt const&) () from /opt/SPECTRUM/lib/libgserv.so.1
#0  0x00007fd823dabb00 in CsCoreIf::get_serv_id_prec_node(CsServiceIDInt const&) () from /opt/SPECTRUM/lib/libgserv.so.1
#1  0x00007fd823dabb5f in CsCoreIf::is_local_primary(CsServiceIDInt const&, int) () from /opt/SPECTRUM/lib/libgserv.so.1
#2  0x00007fd828bcac4e in CsLandscape::get_landscape(CsLscpeHandle const&, bool, bool) () from /opt/SPECTRUM/lib/../SS/libsskrnl.so.1
#3  0x00007fd823daceb4 in CsDLscpeIf::CsDLscpeIf(CsLscpeHandle const&, bool, bool) () from /opt/SPECTRUM/lib/libgserv.so.1
#4  0x00007fd823db07da in CsDModelIf::read(CsAttrValList*, CsSecurityIf const*) const () from /opt/SPECTRUM/lib/libgserv.so.1
#5  0x00007fd827ad24f9 in CsDistVnmModelHandle::read(CsAttrValList*) const () from /opt/SPECTRUM/lib/../SS/libIHapi.so.1
#6  0x00007fd7f3296230 in SLMRMConditionAlarmFinder::find_alarm(CsModelHandle const&, int&) () from /opt/CA/Spectrum/SS/Modules/libslm.so.1
#7  0x00007fd7f3281061 in SLMIHResourceMonitorBase::find_alarm(CsModelHandle const&, SLMMonitorPolicy*, SLMDomain::TriggerCause&, SLMDefs::RootCauseSearchMode_e) () from /opt/CA/Spectrum/SS/Modules/libslm.so.1
#8  0x00007fd7f32812ce in SLMIHResourceMonitorBase::get_trigger_cause_list(CsModelHandle const&, SLMDomain::TriggerCauseList&, SLMMonitorPolicy const*, SLMRule const*, SLMDefs::RootCauseSearchMode_e) () from /opt/CA/Spectrum/SS/Modules/libslm.so.1
#9  0x00007fd7f32816d7 in SLMIHResourceMonitorBase::make_ServiceRootCause(SLMDomain::ServiceRootCause&, CsModelHandle const&, char const*, SLMMonitorPolicy const*, SLMRule const*, CsModelHandle const*, SLMDefs::RootCauseSearchMode_e) ()
   from /opt/CA/Spectrum/SS/Modules/libslm.so.1
#10 0x00007fd7f3281f55 in SLMIHResourceMonitorBase::handle_get_root_cause_action(CsModelHandle const&, CsAction const*, bool) () from /opt/CA/Spectrum/SS/Modules/libslm.so.1
#11 0x00007fd7f3283618 in SLMIHResourceMonitorBase::trig_action(CsModelHandle const&, CsAction const*, CsConnHandle const&) () from /opt/CA/Spectrum/SS/Modules/libslm.so.1
#12 0x00007fd7f325431a in SLMIHAttrResourceMonitor::trig_action(CsModelHandle const&, CsAction const*, CsConnHandle const&) () from /opt/CA/Spectrum/SS/Modules/libslm.so.1
#13 0x00007fd828bd510e in CsModelType::trig_action(CsModelHandle const&, CsAction const*, CsVPConnHandle const&) () from /opt/SPECTRUM/lib/../SS/libsskrnl.so.1
#14 0x00007fd828bf6f71 in CsModel::action(CsAction*, CsVPConnHandle const&, CsSecurityIf const*) () from /opt/SPECTRUM/lib/../SS/libsskrnl.so.1
#15 0x00007fd823db1d5a in CsDModelIf::action(CsAction*, CsVPConnHandle const&, CsSecurityIf const*) const () from /opt/SPECTRUM/lib/libgserv.so.1
#16 0x00007fd7f327a8bd in SLMIHResourceMonitorBase::send_action_to_children(CsModelHandle const&, unsigned int, CsULHashTable const*, SLMIHResourceMonitorBase::BaseMonitorData&, void*) () from /opt/CA/Spectrum/SS/Modules/libslm.so.1
#17 0x00007fd7f3281f93 in SLMIHResourceMonitorBase::handle_get_root_cause_action(CsModelHandle const&, CsAction const*, bool) () from /opt/CA/Spectrum/SS/Modules/libslm.so.1
#18 0x00007fd7f3283618 in SLMIHResourceMonitorBase::trig_action(CsModelHandle const&, CsAction const*, CsConnHandle const&) () from /opt/CA/Spectrum/SS/Modules/libslm.so.1
#19 0x00007fd7f325431a in SLMIHAttrResourceMonitor::trig_action(CsModelHandle const&, CsAction const*, CsConnHandle const&) () from /opt/CA/Spectrum/SS/Modules/libslm.so.1
#20 0x00007fd828bd510e in CsModelType::trig_action(CsModelHandle const&, CsAction const*, CsVPConnHandle const&) () from /opt/SPECTRUM/lib/../SS/libsskrnl.so.1
#21 0x00007fd828bf6f71 in CsModel::action(CsAction*, CsVPConnHandle const&, CsSecurityIf const*) () from /opt/SPECTRUM/lib/../SS/libsskrnl.so.1
#22 0x00007fd823db1d5a in CsDModelIf::action(CsAction*, CsVPConnHandle const&, CsSecurityIf const*) const () from /opt/SPECTRUM/lib/libgserv.so.1

Cause

There is a loop in the service hierarchy.

Environment

Release : 10.4.1

Component : Spectrum Core / SpectroSERVER

Resolution

Resolve the loop in the service hierarchy.

There may also be a time when the SS does not actually crash however the OneClick clients will be VERY slow and may not load due to this.