AAI not always generating an SNMP Alert
2021-08-12 09:37:13,964 WARN [JawsSendSnmpTrap] java.lang.IllegalArgumentException: Variable of a VariableBinding must not be null
When SNMP alerts are not generated the message below is seen:
WARN [JawsSendSnmpTrap] java.lang.IllegalArgumentException: Variable of a VariableBinding must not be null
When SNMP alerts are generated the message below is seen:
WARN [JawsSendSnmpTrap] Response Event is null. Either no response or timed out
If you enable DEBUG Logging for JawsMibVars, JawsSendSnmpTrap, and AlertGenerator, you can trace out when the Alert occurred and what happened when the SNMP trap was supposed to be sent.
When if fails it looks like below.
2021-08-12 09:37:13,917 DEBUG [JawsSendSnmpTrap] Got parameters for the SNMP Manager: Host= x.x.x.x Port= 162 Community=
2021-08-12 09:37:13,917 DEBUG [JawsMibVars] 0>targetJobName:TargetJob
2021-08-12 09:37:13,917 DEBUG [JawsMibVars] 1>runStartTime:08/11/2021 12:02:58 PDT
2021-08-12 09:37:13,917 DEBUG [JawsMibVars] 2>alertType:Exceeded SLA
2021-08-12 09:37:13,917 DEBUG [JawsMibVars] 3>currentlyRunningJobs:28
2021-08-12 09:37:13,917 DEBUG [JawsMibVars] 4>jobStreamPctComplete:85.7955151311065
2021-08-12 09:37:13,917 DEBUG [JawsMibVars] 5>earlyLate:3:40:21
2021-08-12 09:37:13,917 DEBUG [JawsMibVars] 6>elapsedTime:21:33:16
2021-08-12 09:37:13,917 DEBUG [JawsMibVars] 7>alertTime:08/12/2021 09:37:08 PDT
2021-08-12 09:37:13,917 DEBUG [JawsMibVars] 8>avgEndTime:08/12/2021 22:58:57 PDT
2021-08-12 09:37:13,917 DEBUG [JawsMibVars] 9>jobsCompleted:1487
2021-08-12 09:37:13,917 DEBUG [JawsMibVars] 10>jobsInJobstream:2257
2021-08-12 09:37:13,917 DEBUG [JawsMibVars] 11>jobsPredictedToRun:28
2021-08-12 09:37:13,917 DEBUG [JawsMibVars] 12>predictedEndTime:08/12/2021 13:10:20 PDT
2021-08-12 09:37:13,917 DEBUG [JawsMibVars] 13>statsGeneratedTime:08/12/2021 09:36:14 PDT
2021-08-12 09:37:13,917 DEBUG [JawsMibVars] 14>criticality:critical
2021-08-12 09:37:13,917 DEBUG [JawsMibVars] 15>userComment:NA
2021-08-12 09:37:13,917 DEBUG [JawsMibVars] 16>instanceName:N/A
2021-08-12 09:37:13,917 DEBUG [JawsMibVars] 17>schedulerName:Tidal
2021-08-12 09:37:13,917 DEBUG [JawsMibVars] 18>jobstreamName:JobstreamName
2021-08-12 09:37:13,917 DEBUG [JawsMibVars] 19>rootCause:NA
2021-08-12 09:37:13,917 DEBUG [JawsMibVars] 20>jawsServerID:AAI
2021-08-12 09:37:13,917 DEBUG [JawsMibVars] 21>jawsServerHostname:xxxxxxxxx
2021-08-12 09:37:13,917 DEBUG [JawsMibVars] 22>jobstreamUrl:http://xxxxxxxx:8080/aai/launch.jnlp?stream=AXxxxxxxI=
2021-08-12 09:37:13,917 DEBUG [JawsMibVars] 23>jobstreamRunId:AXxxxxx=
2021-08-12 09:37:13,917 DEBUG [JawsMibVars] 24>lateEndTime:08/12/2021 09:30:00 PDT
2021-08-12 09:37:13,917 DEBUG [JawsMibVars] 25>businessAreas:Credit Risk Reporting (F57 / X74)
2021-08-12 09:37:13,917 DEBUG [JawsMibVars] 26>currentlyRunningJobNames: JobName, JobName, JobName, JobName, JobName, JobName, JobName, JobName, JobName, JobName, JobName, JobName, JobName, JobName, JobName, JobName,JobName,JobName,JobName,JobName,JobName,JobName,JobName,JobName,JobName,JobName,JobName,JobName,JobName,JobName,JobName,JobName,JobName,JobName,JobName,JobName,JobName,JobName,JobName,JobName,JobName,JobName,JobName,JobName,JobName,
2021-08-12 09:37:13,917 DEBUG [JawsMibVars] 27>jobStreamAnnotation:NA
2021-08-12 09:37:13,917 DEBUG [JawsSendSnmpTrap] ***** Sending SNMP v3 Trap
2021-08-12 09:37:13,917 DEBUG [JawsSendSnmpTrap] Sending SNMP V3 Message type -89 to 1x.x.x.x:162::VS=28
2021-08-12 09:37:13,964 DEBUG [JawsSendSnmpTrap] Compiling TermaMib 1/1
2021-08-12 09:37:13,964 WARN [JawsSendSnmpTrap] java.lang.IllegalArgumentException: Variable of a VariableBinding must not be null
2021-08-12 09:37:13,979 DEBUG [JawsSendSnmpTrap] Done Sending Message
Release : 6.3.0
Component : AUTOMIC AUTOMATION INTELLIGENCE ENGINE
Found that certain SNMP fields such as currentlyRunningJobs or rootCauses can have a list of jobs or other details that are over 255 characters, and if so, it will cause the error below and a trap will not be sent:
WARN [JawsSendSnmpTrap] java.lang.IllegalArgumentException: Variable of a VariableBinding must not be null
We found the error above was seen, whenever there was a SNMP Trap field with a value over 255 characters, such as the list of Currently Running Jobs or Root.
This can be seen with the JawsMibVars logger set to DEBUG.
Defect DE512097 is resolved in AAI 6.4.0 release.
Now when a trap sends a value with over 252 characters, the message below will be logged, and the trap will still be sent.
WARN [JawsMibVars] Value for currentlyRunningJobNames is longer than 255 char, truncating