SpectroSERVER Crash while reconfiguring a device model
search cancel

SpectroSERVER Crash while reconfiguring a device model

book

Article ID: 239231

calendar_today

Updated On:

Products

CA Spectrum DX NetOps

Issue/Introduction


The SpectroSERVER crashed several times while reconfiguring a device model

The core stack will show the following:

(gdb) where
#0  0x00007f53fe3e8d91 in __strncpy_ssse3 () from /lib64/libc.so.6
#1  0x00007f5402c5878e in attrdup(void const*, CsAttrDesc::CsAttrType_e) () from /opt/SPECTRUM/lib/libVPapi.so.1
#2  0x00007f5402c6115f in CsAttrVal::CsAttrVal(CsAttrVal const&) () from /opt/SPECTRUM/lib/libVPapi.so.1
#3  0x00007f5402c62a81 in CsAttrValList::CsAttrValList(CsAttrValList const*) () from /opt/SPECTRUM/lib/libVPapi.so.1
#4  0x00007f540db44ecd in CsModel::write(CsAttrValList*, unsigned char, char const*, CsSecurityIf const*) () from /opt/SPECTRUM/lib/../SS/libsskrnl.so.1
#5  0x00007f540db60ae2 in CsModelIf::write(CsAttrValList*, unsigned char, char const*, CsSecurityIf const*) const () from /opt/SPECTRUM/lib/../SS/libsskrnl.so.1
#6  0x00007f540ca31bf8 in CsVnmModelHandle::write(CsAttrValList*, char const*) const () from /opt/SPECTRUM/lib/../SS/libIHapi.so.1
#7  0x00007f540319aa8e in CsIHSyncRead::trig_read(CsModelHandle const&, unsigned int, CsReadInfo const*) () from /opt/SPECTRUM/lib/../SS/libgmmintel.so.1
#8  0x00007f540db40000 in CsModel::get_calc_attr_val(CsMTypeAttr const*, CsObjectID const*, unsigned char) const () from /opt/SPECTRUM/lib/../SS/libsskrnl.so.1
#9  0x00007f540db45437 in CsModel::read_ulong(unsigned int, CsError::CsError_e*, CsSecurityIf const*) const () from /opt/SPECTRUM/lib/../SS/libsskrnl.so.1
#10 0x00007f540db61fd4 in CsModelIf::read_ulong(unsigned int, CsError::CsError_e*) const () from /opt/SPECTRUM/lib/../SS/libsskrnl.so.1
#11 0x00007f540ca25e4d in CsIHBase::read_ulong(CsModelHandle const&, unsigned int, CsError::CsError_e&) () from /opt/SPECTRUM/lib/../SS/libIHapi.so.1
#12 0x00007f540b8b00f3 in CsIHGetPorts::is_physical_port(CsModelHandle const&) () from /opt/SPECTRUM/lib/../SS/libmdlsvint.so.1
#13 0x00007f540b8b0eff in CsIHGetPorts::get_physical_ports(CsModelHandle const&, ModelHandleSet&, int) () from /opt/SPECTRUM/lib/../SS/libmdlsvint.so.1
#14 0x00007f540b8b1e37 in CsIHGetPorts::trig_action(CsModelHandle const&, CsAction const*) () from /opt/SPECTRUM/lib/../SS/libmdlsvint.so.1
#15 0x00007f540db6b37e in CsModelType::trig_action(CsModelHandle const&, CsAction const*, CsVPConnHandle const&) () from /opt/SPECTRUM/lib/../SS/libsskrnl.so.1
#16 0x00007f540db42151 in CsModel::action(CsAction*, CsVPConnHandle const&, CsSecurityIf const*) () from /opt/SPECTRUM/lib/../SS/libsskrnl.so.1
#17 0x00007f5408cf573a in CsDModelIf::action(CsAction*, CsVPConnHandle const&, CsSecurityIf const*) const () from /opt/SPECTRUM/lib/libgserv.so.1
#18 0x00007f5408cf7122 in CsDModelIf::dispatch(CsVnmMsg*, CsVPConnHandle const&, CsSecurityIf const*) () from /opt/SPECTRUM/lib/libgserv.so.1
#19 0x00007f540db6310e in CsMultiReqScheduler::dispatch_request(CsMultiReqMsg*) () from /opt/SPECTRUM/lib/../SS/libsskrnl.so.1
#20 0x00007f540db6359f in CsMultiReqScheduler::process_requests() () from /opt/SPECTRUM/lib/../SS/libsskrnl.so.1
#21 0x00007f540db63625 in CsMultiReqScheduler::process_requests(CsMultiReqScheduler*&) () from /opt/SPECTRUM/lib/../SS/libsskrnl.so.1
#22 0x00007f540db2cc2c in CsLandscape::multi_model_request(CsModelActionList*, CsVPConnHandle const&, CsSecurityIf const*) () from /opt/SPECTRUM/lib/../SS/libsskrnl.so.1
#23 0x00007f540db5ecc7 in CsModelDomainSrvc::doActionOnModelsInt(unsigned int, CORBA_ULongSeq const&, CsCAttribute::CsCAttrValList const&, CsSecurityIf const&) ()
   from /opt/SPECTRUM/lib/../SS/libsskrnl.so.1
#24 0x00007f540daa497a in CModelDomainItcM::processItcRequest(ITC_Request_Parms*) () from /opt/SPECTRUM/lib/../SS/libsskrnl.so.1
#25 0x00007f540b0e877b in ITC_Request_Parms_Corba::processRequest_TransferExceptions() () from /opt/SPECTRUM/lib/libitc.so.1
#26 0x00007f540b0e7b37 in ItcWorkQueue::process_work_item(ItcQdItem*) () from /opt/SPECTRUM/lib/libitc.so.1
#27 0x00007f540b0e7972 in ItcWorkQueue::process_work_node(CsWorkNode*) () from /opt/SPECTRUM/lib/libitc.so.1
#28 0x00007f5408a76a70 in CsWorkScheduler::do_work() () from /opt/SPECTRUM/lib/libwkmgr.so.1
#29 0x00007f540d7d2381 in moot_thread_start () from /opt/SPECTRUM/lib/libmoot.so.1
#30 0x00007f53fe2da190 in ____strtof_l_internal () from /lib64/libc.so.6
#31 0x0000000000000000 in ?? ()

OR

Program terminated with signal 11, Segmentation fault.
#0 0x00007fc72a06ea8c in __memcpy_ssse3_back () from /lib64/libc.so.6
#0 0x00007fc72a06ea8c in __memcpy_ssse3_back () from /lib64/libc.so.6
#1 0x00007fc72e8de78e in attrdup(void const*, CsAttrDesc::CsAttrType_e) () from /opt/SPECTRUM/lib/libVPapi.so.1
#2 0x00007fc72e8e715f in CsAttrVal::CsAttrVal(CsAttrVal const&) () from /opt/SPECTRUM/lib/libVPapi.so.1
#3 0x00007fc72e8e8a81 in CsAttrValList::CsAttrValList(CsAttrValList const*) () from /opt/SPECTRUM/lib/libVPapi.so.1
#4 0x00007fc7397dedcd in CsModel::write(CsAttrValList*, unsigned char, char const*, CsSecurityIf const*) () from /opt/SPECTRUM/lib/../SS/libsskrnl.so.1
#5 0x00007fc7397f94f2 in CsModelIf::write(CsAttrValList*, unsigned char, char const*, CsSecurityIf const*) const () from /opt/SPECTRUM/lib/../SS/libsskrnl.so.1
#6 0x00007fc7386b4bf8 in CsVnmModelHandle::write(CsAttrValList*, char const*) const () from /opt/SPECTRUM/lib/../SS/libIHapi.so.1
#7 0x00007fc72ee20a8e in CsIHSyncRead::trig_read(CsModelHandle const&, unsigned int, CsReadInfo const*) () from /opt/SPECTRUM/lib/../SS/libgmmintel.so.1
#8 0x00007fc7397d9f00 in CsModel::get_calc_attr_val(CsMTypeAttr const*, CsObjectID const*, unsigned char) const () from /opt/SPECTRUM/lib/../SS/libsskrnl.so.1
#9 0x00007fc7397dd7d7 in CsModel::get_calc(CsULongList&, CsAttrValList*) () from /opt/SPECTRUM/lib/../SS/libsskrnl.so.1
#10 0x00007fc7397de94a in CsModel::read(CsAttrValList*, unsigned char, CsSecurityIf const*) () from /opt/SPECTRUM/lib/../SS/libsskrnl.so.1
#11 0x00007fc7397f92b2 in CsModelIf::read(CsAttrValList*, CsSecurityIf const*) const () from /opt/SPECTRUM/lib/../SS/libsskrnl.so.1
#12 0x00007fc7386b4b2a in CsVnmModelHandle::read(CsAttrValList*) const () from /opt/SPECTRUM/lib/../SS/libIHapi.so.1
#13 0x00007fc7375549f9 in CsIHIfConfig::get_model_list(CsModelHandle const&, CsModelHandle const&, CsIntfTable*) () from /opt/SPECTRUM/lib/../SS/libmdlsvint.so.1
#14 0x00007fc7375530df in CsIHIfConfig::compare_models_to_mib(CsModelHandle const&, CsIntfTable*, int, int) () from /opt/SPECTRUM/lib/../SS/libmdlsvint.so.1
#15 0x00007fc7375518c4 in CsIHIfConfig::finish_if_change(CsModelHandle const&) () from /opt/SPECTRUM/lib/../SS/libmdlsvint.so.1
#16 0x00007fc7375675b2 in CsIHIfConfig::interface_change(CsModelHandle const&, CsIHIfConfig::CsReconfiguration_type, int, int) ()
 from /opt/SPECTRUM/lib/../SS/libmdlsvint.so.1
#17 0x00007fc737549b1c in CsIHIfConfig::trig_watch_change(CsModelHandle const&, CsModelHandle const&, CsMTypeHandle const&, CsAttrWatch const*, CsChangeNode const*) () from /opt/SPECTRUM/lib/../SS/libmdlsvint.so.1
#18 0x00007fc73975e961 in CsIHMdlAttrWatcher::notify(CsIncidentParm const*, CsSecurityIf const*) () from /opt/SPECTRUM/lib/../SS/libsskrnl.so.1
#19 0x00007fc7397d5cfe in CsModel::react_to_change(CsVPList&) () from /opt/SPECTRUM/lib/../SS/libsskrnl.so.1
#20 0x00007fc7397dfe32 in CsModel::process_changes() () from /opt/SPECTRUM/lib/../SS/libsskrnl.so.1
#21 0x00007fc7397fb9f9 in CsNotificationMgr::process_queued_work(CsWorkNode const*) () from /opt/SPECTRUM/lib/../SS/libsskrnl.so.1
#22 0x00007fc7346fd512 in CsWorkQueue::process_work_node(CsWorkNode*) () from /opt/SPECTRUM/lib/libwkmgr.so.1
#23 0x00007fc7346fca70 in CsWorkScheduler::do_work() () from /opt/SPECTRUM/lib/libwkmgr.so.1
#24 0x00007fc739453211 in moot_thread_start () from /opt/SPECTRUM/lib/libmoot.so.1
#25 0x00007fc729f60190 in ?? () from /lib64/libc.so.6
#26 0x0000000000000000 in ?? ()Program terminated with signal 11, Segmentation fault.
#0 0x00007fc72a06ea8c in __memcpy_ssse3_back () from /lib64/libc.so.6
#0 0x00007fc72a06ea8c in __memcpy_ssse3_back () from /lib64/libc.so.6
#1 0x00007fc72e8de78e in attrdup(void const*, CsAttrDesc::CsAttrType_e) () from /opt/SPECTRUM/lib/libVPapi.so.1
#2 0x00007fc72e8e715f in CsAttrVal::CsAttrVal(CsAttrVal const&) () from /opt/SPECTRUM/lib/libVPapi.so.1
#3 0x00007fc72e8e8a81 in CsAttrValList::CsAttrValList(CsAttrValList const*) () from /opt/SPECTRUM/lib/libVPapi.so.1
#4 0x00007fc7397dedcd in CsModel::write(CsAttrValList*, unsigned char, char const*, CsSecurityIf const*) () from /opt/SPECTRUM/lib/../SS/libsskrnl.so.1
#5 0x00007fc7397f94f2 in CsModelIf::write(CsAttrValList*, unsigned char, char const*, CsSecurityIf const*) const () from /opt/SPECTRUM/lib/../SS/libsskrnl.so.1
#6 0x00007fc7386b4bf8 in CsVnmModelHandle::write(CsAttrValList*, char const*) const () from /opt/SPECTRUM/lib/../SS/libIHapi.so.1
#7 0x00007fc72ee20a8e in CsIHSyncRead::trig_read(CsModelHandle const&, unsigned int, CsReadInfo const*) () from /opt/SPECTRUM/lib/../SS/libgmmintel.so.1
#8 0x00007fc7397d9f00 in CsModel::get_calc_attr_val(CsMTypeAttr const*, CsObjectID const*, unsigned char) const () from /opt/SPECTRUM/lib/../SS/libsskrnl.so.1
#9 0x00007fc7397dd7d7 in CsModel::get_calc(CsULongList&, CsAttrValList*) () from /opt/SPECTRUM/lib/../SS/libsskrnl.so.1
#10 0x00007fc7397de94a in CsModel::read(CsAttrValList*, unsigned char, CsSecurityIf const*) () from /opt/SPECTRUM/lib/../SS/libsskrnl.so.1
#11 0x00007fc7397f92b2 in CsModelIf::read(CsAttrValList*, CsSecurityIf const*) const () from /opt/SPECTRUM/lib/../SS/libsskrnl.so.1
#12 0x00007fc7386b4b2a in CsVnmModelHandle::read(CsAttrValList*) const () from /opt/SPECTRUM/lib/../SS/libIHapi.so.1
#13 0x00007fc7375549f9 in CsIHIfConfig::get_model_list(CsModelHandle const&, CsModelHandle const&, CsIntfTable*) () from /opt/SPECTRUM/lib/../SS/libmdlsvint.so.1
#14 0x00007fc7375530df in CsIHIfConfig::compare_models_to_mib(CsModelHandle const&, CsIntfTable*, int, int) () from /opt/SPECTRUM/lib/../SS/libmdlsvint.so.1
#15 0x00007fc7375518c4 in CsIHIfConfig::finish_if_change(CsModelHandle const&) () from /opt/SPECTRUM/lib/../SS/libmdlsvint.so.1
#16 0x00007fc7375675b2 in CsIHIfConfig::interface_change(CsModelHandle const&, CsIHIfConfig::CsReconfiguration_type, int, int) ()
 from /opt/SPECTRUM/lib/../SS/libmdlsvint.so.1
#17 0x00007fc737549b1c in CsIHIfConfig::trig_watch_change(CsModelHandle const&, CsModelHandle const&, CsMTypeHandle const&, CsAttrWatch const*, CsChangeNode const*) () from /opt/SPECTRUM/lib/../SS/libmdlsvint.so.1
#18 0x00007fc73975e961 in CsIHMdlAttrWatcher::notify(CsIncidentParm const*, CsSecurityIf const*) () from /opt/SPECTRUM/lib/../SS/libsskrnl.so.1
#19 0x00007fc7397d5cfe in CsModel::react_to_change(CsVPList&) () from /opt/SPECTRUM/lib/../SS/libsskrnl.so.1
#20 0x00007fc7397dfe32 in CsModel::process_changes() () from /opt/SPECTRUM/lib/../SS/libsskrnl.so.1
#21 0x00007fc7397fb9f9 in CsNotificationMgr::process_queued_work(CsWorkNode const*) () from /opt/SPECTRUM/lib/../SS/libsskrnl.so.1
#22 0x00007fc7346fd512 in CsWorkQueue::process_work_node(CsWorkNode*) () from /opt/SPECTRUM/lib/libwkmgr.so.1
#23 0x00007fc7346fca70 in CsWorkScheduler::do_work() () from /opt/SPECTRUM/lib/libwkmgr.so.1
#24 0x00007fc739453211 in moot_thread_start () from /opt/SPECTRUM/lib/libmoot.so.1
#25 0x00007fc729f60190 in ?? () from /lib64/libc.so.6
#26 0x0000000000000000 in ?? ()

Environment

Release : 21.2.6, 21.2.8, 21.2.10

Component : SPCCSS - Spectrum Core / SpectroSERVER

Cause

The root cause of the crash is because of a error in the syncing of external attributes data with internal attributes section. The problem occurs when trying to sync a string type attribute with an integer/long type attribute.

Resolution

Please contact Spectrum support for the below patches which will resolve the issue:

21.2.6   -> Spectrum_21.02.06.D62
21.2.8   -> Spectrum_21.02.08.D63
21.2.10 -> Spectrum_21.02.10.D72


Additional Information

  • The fix for this issue is included in 21.2.12 or greater.   
  • The current GA release as of Feb 2023 is 22.2.5
Powered by Wolken Software