Random Spectrum Crashes After Upgrading to 23.3.3 or 23.3.4
Article ID: 277868
Updated On:
Products
Issue/Introduction
After upgrading Spectrum to 23.3.3 or 23.3.4 versions, a random crash can occur. The core file stack trace may show the following:
STACK TRACE:
----------------------
#0 0x00007f5efa654c62 in CsUniqueIDInt::operator==(CsUniqueIDInt const&) const () from /opt/SPECTRUM/lib/libGlobl.so.1
#1 0x00007f5f02a677e4 in CsSharedGlobalAlarmNode::compare_keys(CsSharedGlobalAlarmNode const*, CsSharedGlobalAlarmNode const*) () from /opt/SPECTRUM/lib/../SS/libgas.so.1
#2 0x00007f5efa62a4d9 in CsGHashTable::get_node(void const*) const () from /opt/SPECTRUM/lib/libGlobl.so.1
#3 0x00007f5efa62a511 in CsGHashTable::get(void const*) () from /opt/SPECTRUM/lib/libGlobl.so.1
#4 0x00007f5f02a675ca in CsSharedGlobalAlarmList::get(CsGlobalAlarmID const&) const () from /opt/SPECTRUM/lib/../SS/libgas.so.1
#5 0x00007f5f02a61f75 in CsPriorityFilterService::change_alarm(CsSharedAttrsChange*) () from /opt/SPECTRUM/lib/../SS/libgas.so.1
#6 0x00007f5f02a34aba in CsGlobalAlarmClient::notify_about_changed_alarm(CsSharedAttrsChange*) () from /opt/SPECTRUM/lib/../SS/libgas.so.1
#7 0x00007f5f02a3a484 in CsGlobalAlarmAttachList::notify_about_changed_alarm(CsSharedAttrsChange*) () from /opt/SPECTRUM/lib/../SS/libgas.so.1
#8 0x00007f5f02a31c58 in CsGlobalAlarmClientHandler::update_alarm(CsGlobalAlarmAttrs const&) () from /opt/SPECTRUM/lib/../SS/libgas.so.1
#9 0x00007f5f02a3fd86 in CsLocalAlarmTable::notify_clients_of_change(CsGlobalAlarmAttrs*) () from /opt/SPECTRUM/lib/../SS/libgas.so.1
#10 0x00007f5f02a4125b in CsLocalAlarmTable::change(CsGlobalAlarmAttrs*, int) () from /opt/SPECTRUM/lib/../SS/libgas.so.1
#11 0x00007f5f0273f96c in CsEventDispActionAlarm::rem_alarms(CsEventMessage const&, CsGlobalAlarmList const&) () from /opt/SPECTRUM/lib/../SS/libems.so.1
#12 0x00007f5f0273feb6 in CsEventDispActionAlarm::clear_alarm(CsEventMessage&, bool, CsGenAttrs const*) () from /opt/SPECTRUM/lib/../SS/libems.so.1
#13 0x00007f5f02740399 in CsEventDispActionClearAlarm::process_event(CsEventMessage&, CsGenAttrs const*, int) () from /opt/SPECTRUM/lib/../SS/libems.so.1
#14 0x00007f5f0274ab79 in CsEventDispose::process_event(CsEventMessage&, CsGenAttrs const*, int) () from /opt/SPECTRUM/lib/../SS/libems.so.1
#15 0x00007f5f0273adc5 in CsEventDispTable::process_event(CsEventMessage&, CsLscpeHandle const&, CsGenAttrs const*, int) () from /opt/SPECTRUM/lib/../SS/libems.so.1
#16 0x00007f5f05b8f306 in CsVnmProxyEventLogMgr::process_event(CsEventMessage&, CsLscpeHandle const&, int, int, CsGenAttrs const*, int) () from /opt/SPECTRUM/lib/../SS/libsskrnl.so.1
#17 0x00007f5f00cad84e in CsEventIf::process_event(CsEventMessage&, int, CsGenAttrs const*, int) () from /opt/SPECTRUM/lib/libgserv.so.1
#18 0x00007f5f05b23611 in CsModelType::trig_event(CsModelHandle const&, CsEventMessage*, int, CsGenAttrs const*, int) () from /opt/SPECTRUM/lib/../SS/libsskrnl.so.1
#19 0x00007f5f05b407d2 in CsModel::process_event(CsEventMessage*, int, CsGenAttrs const*, CsSecurityIf const*, int) () from /opt/SPECTRUM/lib/../SS/libsskrnl.so.1
#20 0x00007f5f05b68ac5 in CsModelIf::process_event(CsEventMessage*, int, CsGenAttrs const*, int) const () from /opt/SPECTRUM/lib/../SS/libsskrnl.so.1
#21 0x00007f5f04a06e24 in CsIHProcessEvent::process_event(CsEventMessage*, int, int) () from /opt/SPECTRUM/lib/../SS/libIHapi.so.1
#22 0x00007f5f05ae2761 in CsIHSecondaryLscpeConn::notify_new_connection(CsSecondaryConnect*) () from /opt/SPECTRUM/lib/../SS/libsskrnl.so.1
#23 0x00007f5f05ae2bb0 in CsIHSecondaryLscpeConn::trig_new_connection(int) () from /opt/SPECTRUM/lib/../SS/libsskrnl.so.1
#24 0x00007f5f05ae2be5 in connect_callback(void*, int) () from /opt/SPECTRUM/lib/../SS/libsskrnl.so.1
#25 0x00007f5f00c95e1b in CsConnectionMgr::do_connection_notify() () from /opt/SPECTRUM/lib/libgserv.so.1
#26 0x00007f5f057b8291 in moot_thread_start () from /opt/SPECTRUM/lib/libmoot.so.1
#27 0x00007f5ef5c62190 in ?? () from /lib64/libc.so.6
#28 0x0000000000000000 in ?? ()
Environment
Spectrum 23.3.3 & 23.3.4
Cause
SpectroSERVER may experience random crashes due to SDN-SNMP Alarm forwarding functionality.
Resolution
The cause of the issue was corrected in Spectrum 23.3.5, which solved the issue.
If you cannot upgrade to 23.3.5 at this time, please contact Broadcom support for either of the below patches which can be installed to resolve the issue.
23.3.3 - Spectrum_23.03.03.D250b
23.3.4 - Spectrum_23.03.04.D248b
Additional Information
Spectrum 23.3.5 is planned to be released still in January 2024.
Feedback
