JWP/JCP will not start - Unhandled Exception in thread Framework Event Dispatcher: Equinox Container

Products

• CA Automic Workload Automation - Automation Engine
• CA Automic One Automation

Issue/Introduction

J*P process won't start after being stopped in some cases.  On SQL server, the following show in the JxP logs:

20240311/114825.843 - 1      U00045014 Exception 'java.lang.NullPointerException: "null"' at 'java.util.Objects.requireNonNull():221'.
20240311/114825.843 - 1      U00003620 Routine 'com.automic.kernel.impl.ServerProcess' forces trace because of error.
20240311/114825.859 - 1      U00003450 The TRACE file was opened with the switches '0000000000000000'.

On Linux/Oracle (21.0.8) the JWP log shows:

20240307/150648.390 - 60     U00045439 The server process removed its registration from the database.
20240307/150648.446 - 60     U00045000 Database connection with session ID '826' was closed.
20240307/150648.466 - 60     U00045000 Database connection with session ID '866' was closed.
20240307/150648.503 - 60     U00003124 ListenSocket with port number '[0:0:0:0:0:0:0:0]:2275' has been closed.

Trace shows:

20240307/150641.069 - 1      U00045014 Exception 'java.lang.NullPointerException: "null"' at 'java.util.Objects.requireNonNull():222'.
20240307/150641.081 - 1      U00003620 Routine 'com.automic.kernel.impl.ServerProcess' forces trace because of error.
...
20240307/150641.177 - 1                ----------------------- Stack Trace -----------------------
20240307/150641.183 - 1                java.lang.NullPointerException

Running a tcp/ip=2, db=4 trace will show a null entry for TcpIpAddr2 for a WP:

SELECT MQSRV_Name, MQSRV_Type, MQSRV_TcpIpPort, MQSRV_TcpIpAddr, MQSRV_TcpIpAddr2, MQSRV_MQSet, MQSRV_RESTENDPOINT, MQSRV_StartTime, MQSRV_LastUpdate, MQSRV_NetArea FROM MQSRV WHERE MQSRV_Type IN (1,2,4,16,32,64) ORDER BY MQSRV_Name ASC

and gets results.  In the customer's system, there were 34 WPs running WITH a MQSRV_TcpIPAddr2 as an actual IP address
Then it gets to the first null MQSRV_TcpIPAddr2 and it shows:

20240307/150640.942 - 1      UCUDB32 READ RET 0000 HSTMT: 0000000000000000 VALUE: 0000000000000001 ALL:  0.00000 DB:  0.00000 ODBC:  0.00000 UDB:  0.00000
20240307/150640.960 - 1      U00009909 TRACE:(DB-DATEN: MQSRV_NAME) size 000009
20240307/150640.964 - 1                00000000  44455623 57503031 35                 >AUT#WP015<
20240307/150640.968 - 1      U00009909 TRACE:(DB-DATEN: MQSRV_TYPE) size 000001
20240307/150640.971 - 1                00000000  32                                   >2<
20240307/150640.975 - 1      U00009909 TRACE:(DB-DATEN: MQSRV_TCPIPPORT) size 000001
20240307/150640.979 - 1                00000000  30                                   >0<
20240307/150640.983 - 1      U00009909 TRACE:(DB-DATEN: MQSRV_TCPIPADDR) size 000025
20240307/150640.987 - 1                00000000  75633464 65763033 2D696D64 2E766970  >dns.fqdn.example<
20240307/150640.987 - 1                00000010  2E656261 792E636F 6D                 >.com<
20240307/150640.995 - 1      U00009909 TRACE:(DB-DATEN: MQSRV_TCPIPADDR2) size 000000
20240307/150640.998 - 1                
20240307/150641.000 - 1                                             >(null)<
20240307/150641.004 - 1      U00009909 TRACE:(DB-DATEN: MQSRV_MQSET) size 000001
20240307/150641.008 - 1                00000000  32                                   >1<
20240307/150641.012 - 1      U00009909 TRACE:(DB-DATEN: MQSRV_RESTENDPOINT) size 000000
20240307/150641.015 - 1                
20240307/150641.017 - 1                                             >(null)<
20240307/150641.021 - 1      U00009909 TRACE:(DB-DATEN: MQSRV_STARTTIME) size 000008
20240307/150641.024 - 1                00000000  0000018E 18F21898                    >........<
20240307/150641.028 - 1                                             >2024-03-07 12:45:03.0<
20240307/150641.031 - 1      U00009909 TRACE:(DB-DATEN: MQSRV_LASTUPDATE) size 000008
20240307/150641.034 - 1                00000000  0000018E 19739CD8                    >.....s..<
20240307/150641.037 - 1                                             >2024-03-07 15:06:31.0<
20240307/150641.041 - 1      U00009909 TRACE:(DB-DATEN: MQSRV_NETAREA) size 000003
20240307/150641.045 - 1                00000000  444556                               >AUT<
20240307/150641.051 - 1      UCUDB32 CLST RET 0000 HSTMT: 0000000000000000 VALUE: 0000000000000000
20240307/150641.056 - 1      UCUDB32 RBCK RET 0000 HSTMT: 0000000000000000 VALUE: 0000000000000000 ALL:  0.00100 DB:  0.00000 ODBC:  0.00000 UDB:  0.00000
20240307/150641.069 - 1      U00045014 Exception 'java.lang.NullPointerException: "null"' at 'java.util.Objects.requireNonNull():222'.

Environment

21.0.x before 21.0.10

Cause

This is caused by a defect where TcpIpAddr2 was null for a WP

Resolution

This will be fixed with 21.0.10, currently planned for April of 2024.

A workaround could be to look for WPs in MQSRV where the MQSRV_TcpIpAddr2 entry is null and stop these WPs.  Then start the JxP processes and then the WPs.