Strong Authentication product has been installed and configured in various locations globally. An standalone AuthMinder instance integrated with Oracle Unified Directory. On RHEL 6.7.1 operating system AuthMinder service consuming and storing data in Oracle 11G database and hosted on Tomcat 7.0 version. When the underlying AuthMinder database migrated from 11g to 19c, every couple of hours AuthMinder service is not responding. After restarting the services it works fine for few hours.
After analyzing Arcot WebFort( Strong Auth) logs and compared them with ODBC traces, a few transactions are found stuck. These transactions were invoking multiple threads to database to fetch required data from database. Due to these SQL statements the AuthMinder services is not responding. Strong Auth server has tried to fetch the DB sequence, which was not successful.
02/16/23 13:35:49.472 DEBUG TXN_NATIVE 02397265 1447416787 - ArDBM::Found query string for query-id : [TEMPLATE_WFSEQ_FETCH_SEQ].
02/16/23 13:35:49.472 DEBUG TXN_NATIVE 02397265 1447416787 - ArDBM::Executing Query[WFSequence_FetchSeq]
2023-02-16 13:35:49.473146 (Time elapsed in microseconds : 135) ppid=2395946:pid=2395947:tid=14028304 UCHAR * 0x007f962401aa78  "SELECT SEQUENCENAME, STARTINGVALUE, INCREMENTVALUE, USEDVALUE, DATECREATED, DATEMODIFIED FROM ARWFSEQUENCE WHERE SEQUENCENAME = 'ARWFINSTANCETXNIDSEQ' AND INSTANCENAME='xxxxxxxxx.com-1519387599'\x00"
2023-02-16 13:35:49.473146 (Time elapsed in microseconds : 135) ppid=2395946:pid=2395947:tid=14028304 SDWORD -3
2023-02-16 13:35:49.473240 ppid=2395946:pid=2395947:tid=140283044566784 ENTER SQLExecute
- From that time on-wards, SA server has acknowledged all the incoming TXN_NATIVE requests and assigned the Thread however it was not processed at all.
02/16/23 13:36:49.493 DEBUG MONITOR 02658718 0MONITOR - Thread  has been created for [TXN_NATIVE]. Current number of threads . Max configured 
02/16/23 13:38:49.599 DEBUG MONITOR 02664268 0MONITOR - Thread  has been created for [TXN_NATIVE]. Current number of threads . Max configured 
After analyzing the logs and ODBC trace files and it is found that "TEMPLATE_WFSEQ_FETCH_SEQ" is executed for every transaction. Ideally, this query should have been executed once for every 50 transactions. This interval (50) is configured in the ARWFSEQUENCE table. The query to update the increment value by 50 is mentioned below.
update ARWFSEQUENCE set incrementvalue=50 where instancename='<hostname>';
Note : Need to restart the SA instance after the above change.