Unprocessed NCM bucket files are increasing

Products

• CA Spectrum
• DX NetOps

Issue/Introduction

We are running NetOps 21.2.1 on a distributed RHEL 7 environment. 

Unprocessed bucket files are increasing.

mysql> select count(1) from bucketactivitylog where destroy_time is null;
+----------+
| count(1) |
+----------+
|    13444 |
+----------+
1 row in set (0.04 sec)

 

Cause

SRM was failing to process NCM Events due to NumberFormatException and hence it was skipping the NCM events processing.

In the $SPECROOT/tomcat/logs/catalina.out file:

Aug 09, 2021 17:08:53.393 (SRM/NCMConfigHandler/bucketReader) (SRMNCMHandlerEvents) - (DEBUG) - Unsuccessful configuration capture received - skipping event.  DTO object configId = null ,configTextId = null ,deviceModelKey = 402635 ,changeTime = 2021-03-16 09:50:54.0 ,deviceModelHandle = 0x6002a1f ,prevConfigMH = null ,currConfigMH = null ,trapFrom = Unknown ,trapUser = Unknown ,trapOn = Unknown ,linesChanged = null ,relLinesChanged = null ,violatedPolicies = null ,compliantPolicies = null ,specUserName = N/A ,commMode = N/A ,landscape = reisling ,isSuccessful = false ,captureErrorMsg = 
Aug 09, 2021 17:08:53.429 (SRM/NCMConfigHandler/bucketReader) (com.aprisma.spectrum.app.repmgr.dc.event.handler.VardataMapFactory) - (WARN) - EOF Error while reading vardata. Setting attrVule to 'null' for attrID:13
Aug 09, 2021 17:08:53.431 (SRM/NCMConfigHandler/bucketReader) (com.aprisma.spectrum.app.repmgr.dc.event.handler.NCMConfigHandler) - (ERROR) - Error occurred while processing NCM event bucket, Record: [email protected]
Caused by: java.lang.NumberFormatException: For input string: ""

Environment

Release : 21.2.1

Component : Spectrum Reporting

Resolution

Contact Broadcom support and request the Spectrum_21.02.01.D06 debug patch.

We have handled and fixed the NumberFormatException issue and SRM is able to process all NCM Events successfully.