Autosys WebUI WCC error after upgrade java.sql.SQLRecoverableException: IO Error: The Network Adapter could not establish the connection

Products

• Autosys Workload Automation

Issue/Introduction

Below error is seen in CA-wcc.log afer WCC upgrade:

INFO   | jvm 1    | 2022/04/27 19:51:15 |        4 | Apr 27, 2022 7:51:14 PM com.ca.wcc.dbresource.datasource.UnlockingDatasource setParameters
INFO   | jvm 1    | 2022/04/27 19:51:15 |        4 | INFO: URL= jdbc:oracle:thin:@AUTOSYS_WCC, Driver= oracle.jdbc.driver.OracleDriver
INFO   | jvm 1    | 2022/04/27 19:51:15 |        4 | Apr 27, 2022 7:51:14 PM com.ca.wcc.dbresource.datasource.WccDataSource registerMBean
INFO   | jvm 1    | 2022/04/27 19:51:15 |        4 | INFO: Trying to create connection pool, retry attempt - 1
INFO   | jvm 1    | 2022/04/27 19:51:17 |        6 | Apr 27, 2022 7:51:17 PM org.apache.tomcat.jdbc.pool.ConnectionPool init
INFO   | jvm 1    | 2022/04/27 19:51:17 |        6 | SEVERE: Unable to create initial connections of pool.
INFO   | jvm 1    | 2022/04/27 19:51:17 |        6 | java.sql.SQLRecoverableException: IO Error: The Network Adapter could not establish the connection
........
INFO   | jvm 1    | 2022/04/27 19:51:17 |        6 | Caused by: java.io.IOException: Socket read timed out, socket connect lapse 4 ms. /XX.XX.XX.XX 1521 3 1 true
.....
INFO   | jvm 1    | 2022/04/27 19:51:17 |        6 | Caused by: java.io.InterruptedIOException: Socket read timed out

Environment

Autosys  12.X

 

Cause

Database Client was setup (tnsnames.ora) with load-balanced configuration below:

 

AUTOSYS_WCC =
  (DESCRIPTION = (CONNECT_TIMEOUT=90)(RETRY_COUNT=20)(RETRY_DELAY=3)(TRANSPORT_CONNECT_TIMEOUT=3)
    (ADDRESS_LIST =
      (LOAD_BALANCE = ON)
      (ADDRESS = (PROTOCOL = TCP)(HOST = dbnode1.example.com)(PORT = 1521))
      (ADDRESS = (PROTOCOL = TCP)(HOST = dbnode2.example.com)(PORT = 1521))
      (ADDRESS = (PROTOCOL = TCP)(HOST = dbnode3.example.com)(PORT = 1521))
      (ADDRESS = (PROTOCOL = TCP)(HOST = dbnode4.example.com)(PORT = 1521))
      (ADDRESS = (PROTOCOL = TCP)(HOST = dbnode5.example.com)(PORT = 1521))
      (ADDRESS = (PROTOCOL = TCP)(HOST = dbnode6.example.com)(PORT = 1521))
    )
    (CONNECT_DATA =
      (SERVER = dedicated)
      (SERVICE_NAME = AUTOSYS_WCC)
    )
 )

The TRANSPORT_CONNECT_TIMEOUT of 3 seconds was not enough 

 

When doing a  "tnsping AUTOSYS_WCC"  repeatedly, it was seen that on some occasions, it showed as taking >3 seconds

 

That's why WCC database connections would not stay stable either.

Resolution

1) IncreaseTRANSPORT_CONNECT_TIMEOUT  to a higher value, say 30 seconds:

TRANSPORT_CONNECT_TIMEOUT=30

2) Restart WCC

3) Ensure WCC connections work properly and UI works fine after