Heartbeats for CPM are less than 100%

book

Article ID: 167996

calendar_today

Updated On:

Products

XOS

Issue/Introduction

'Show heartbeats' output may indicate heartbeats from modules to CPM are being lost even if heartbeats are not currently being lost. The fix is available in XOS 9.7.1 or later.
The 'show heartbeat' output on the chassis show that the link quality from other modules to the CPM(s) is not at 100%.

Here is an example of 'show heartbeat output for link quality to CP1 and CP2:

Link Quality TO slot(module): 13(cp1)
FROM 1 2 4 5 6 7 8 9 10 11 13 14
ON ports
CB A: 093% 100% 100% 100% 100% 100% 100% 093% 100% 100% NA 093%
CB B: 093% 086% 100% 093% 100% 093% 093% 100% 100% 100% NA 100%
DP A: 100% NA 100% 100% 100% 100% 100% 100% 100% 100% NA NA
DP B: NA 100% 100% 100% 100% 100% 100% 100% 100% 100% NA NA
DP C: NA NA NA NA NA NA NA NA NA NA NA NA
DP D: NA NA NA NA NA NA NA NA NA NA NA NA

Link Quality TO slot(module): 14(cp2)
FROM 1 2 4 5 6 7 8 9 10 11 13 14
ON ports
CB A: 093% 093% 100% 100% 093% 100% 100% 093% 093% 100% 100% NA
CB B: 100% 093% 093% 100% 100% 093% 100% 100% 100% 100% 093% NA
DP A: NA NA NA NA NA NA NA NA NA NA NA NA
DP B: NA NA NA NA NA NA NA NA NA NA NA NA
DP C: NA NA NA NA NA NA NA NA NA NA NA NA
DP D: NA NA NA NA NA NA NA NA NA NA NA NA

Cause

'Show heartbeat' provides Link quality details of the heartbeats that are used for health check of the modules as described in article 4871. The link quality percentage is based on 16 heartbeats in the span of 4 seconds. However, in XOS versions 9.6.x and later, a benign issue is identified where the heartbeats received by the CPMs are not shown as 100% even though the actual link quality is 100%.
This discrepancy occurs due to a lingering affect of an actual event where the link quality dropped below 100%.

Open a case with Bluecoat/Crossbeam support and provide the following information to validate if the heartbeats are actually being lost or if it's due to the benign issue mentioned above.
------
1. Capture output of cat /proc/heartbeat from CP1 i.e. CPM on slot 13.
2. run following command 5 times
/crossbeam/bin/cbs_hbquery -D 0
3. Repeat steps 1 and 2 followed by one more snapshot of /proc/hearbeat.
4. Capture output of cat /proc/heartbeat from CP2 i.e. CPM on slot 14.
5. run following command 5 times
/crossbeam/bin/cbs_hbquery -D 1
6. Repeat steps 4 and 5 followed by one more snapshot of /proc/hearbeat.
---------

If there is only 1 CPM in the chassis then run steps 1-3 or 4-6 depending on the slot in which the CPM is present.  


Resolution

A patch is available for XOS 9.6.4. The fix is implemented in XOS 9.7.1 or later, and it is also tentatively scheduled to be implemented in XOS 9.6.8.