search cancel

What kind of errors show in AA logs (arcotriskfort.log and arcotwebfort.log) when DB connectivity is hampered? What do the DB errors mean?

book

Article ID: 254640

calendar_today

Updated On:

Products

CA Risk Authentication

Issue/Introduction

What kind of errors show in AA logs (arcotriskfort.log and arcotwebfort.log) when DB connectivity is hampered?

We will discuss some of the errors as shown in this arcotriskfort.log below

============================= =========================================================

Response[7001] Reason[8000]
Fri Oct 07 12:28:48.973 2022 WARNING: pid 502051 tid 1669816: 8: 35:143906866: ARRF_LIB_InsertSysAuditLog. Inserting into ARRFSYSAUDITLOG FAILED.
Fri Oct 07 12:28:48.975 2022 WARNING: pid 502051 tid 1669816: 2: 35:143906867: ArDBM::Caught ArcotException in _DbOp!. err : [Arcot Exception,Error: All database pools are inactive]
Fri Oct 07 12:28:48.975 2022 WARNING: pid 502051 tid 1669816: 8: 35:143906867: Could not fetch database time so using the system current time for processing the request.
ArDBM::Caught ArcotException in _DbOp!. err : [Arcot Exception,Error: All database pools are inactive]
Fri Oct 07 12:28:49.527 2022 WARNING: pid 502051 tid 1670349: 2: 35:143906885: Error [ArDBM::Caught ArcotException in _DbOp!. err : [Arcot Exception,Error: All database pools are inactive]] occurred in retrieveUser for user [01908482516]
Fri Oct 07 12:28:49.527 2022 WARNING: pid 502051 tid 1670349: 2: 35:143906885: ArDBM::Caught ArcotException in _DbOp!. err : [Arcot Exception,Error: All database pools are inactive]
Fri Oct 07 12:28:49.527 2022 WARNING: pid 502051 tid 1670349: 2: 35:143906885: UDS Audit Log error: ArDBM::Caught ArcotException in _DbOp!. err : [Arcot Exception,Error: All database pools are inactive]
Fri Oct 07 12:28:49.527 2022 WARNING: pid 502051 tid 1670349: 2: 35:143906885: ArUDSException caught: Unknown Error
ArDBM::Caught ArcotException in _DbOp!. err : [Arcot Exception,Error: All database pools are inactive]
Fri Oct 07 12:28:49.527 2022 WARNING: pid 502051 tid 1670349: 2: 35:143906885: Error [ArDBM::Caught ArcotException in _DbOp!. err : [Arcot Exception,Error: All database pools are inactive]] occurred in retrieveUser for user [01908482516]
Fri Oct 07 12:28:49.527 2022 WARNING: pid 502051 tid 1670349: 2: 35:143906885: ArDBM::Caught ArcotException in _DbOp!. err : [Arcot Exception,Error: All database pools are inactive]
Fri Oct 07 12:28:49.527 2022 WARNING: pid 502051 tid 1670349: 2: 35:143906885: UDS Audit Log error: ArDBM::Caught ArcotException in _DbOp!. err : [Arcot Exception,Error: All database pools are inactive]
Fri Oct 07 12:28:49.527 2022 WARNING: pid 502051 tid 1670349: 2: 35:143906885: ArUDSException caught: Unknown Error
Fri Oct 07 12:28:49.527 2022 WARNING: pid 502051 tid 1670349: 2: 35:143906885: ArDBM::Caught ArcotException in _DbOp!. err : [Arcot Exception,Error: All database pools are inactive]
Fri Oct 07 12:28:49.527 2022 WARNING: pid 502051 tid 1670349: 8: 35:143906885: fetchDeviceInfoForUser: Error occured while fetching DeviceIds. ArDBM::Caught ArcotException in _DbOp!. err : [Arcot Exception,Error: All database pools are inactive]
Fri Oct 07 12:28:50.053 2022 INFO:    pid 502051 tid 1670405: 2: 35:143906720: Dbm::SQL State:HYT00, Native Code: 7FF700000000, ODBC code: [CA AA][ODBC Oracle Wire Protocol driver]Timeout expired.SQL State:HYT00, Native Code: 7FF700000000, ODBC code: [CA AA][ODBC Oracle Wire Protocol driver]Timeout expired.
Fri Oct 07 12:28:50.053 2022 WARNING: pid 502051 tid 1670405: 2: 35:143906720: ArDBPoolManagerImpl::isKnownFailure: Error state [HYT00] is detected as known failure(type:0)!
Fri Oct 07 12:28:50.053 2022 WARNING: pid 502051 tid 1670405: 2: 35:143906720: ArDBPoolManagerImpl::reportQueryFailure: Query failure is detected as DBFO for primary DSN [arcotdsn] and context [29]. Marking it bad.
Fri Oct 07 12:28:50.053 2022 INFO:    pid 502051 tid 1670405: 2: 35:143906720: ArDBM::Detected a DB-FailOver situation while executing Query[UserAuditRecordInsertQuery]
Fri Oct 07 12:28:50.054 2022 WARNING: pid 502051 tid 1670405: 2: 35:143906720: ArDBM::Caught ArcotException in _DbOp!. err : [Arcot Exception,Error: All database pools are inactive]
Fri Oct 07 12:28:50.054 2022 WARNING: pid 502051 tid 1670405: 2: 35:143906720: UDS Audit Log error: ArDBM::Caught ArcotException in _DbOp!. err : [Arcot Exception,Error: All database pools are inactive]
Fri Oct 07 12:28:50.054 2022 INFO:    pid 502051 tid 1670405: 8: 35:143906720: Response[7664] Reason[8126] Error String [Internal Error:Database Operation Failed.]
Fri Oct 07 12:28:50.054 2022 WARNING: pid 502051 tid 1670405: 8: 35:143906720: ARRF_LIB_InsertSysAuditLog. Inserting into ARRFSYSAUDITLOG FAILED.
Fri Oct 07 12:28:50.058 2022 WARNING: pid 502051 tid 1670405: 2: 35:143906894: ArDBM::Caught ArcotException in _DbOp!. err : [Arcot Exception,Error: All database pools are inactive]
Fri Oct 07 12:28:50.058 2022 WARNING: pid 502051 tid 1670405: 8: 35:143906894: Could not fetch database time so using the system current time for processing the request.
Fri Oct 07 12:28:49.898 2022 INFO:    pid 502051 tid 1670407: 8: 35:143906891: Response[7001] Reason[8000]
Fri Oct 07 12:28:49.898 2022 WARNING: pid 502051 tid 1670407: 8: 35:143906891: ARRF_LIB_InsertSysAuditLog. Inserting into ARRFSYSAUDITLOG FAILED.
Fri Oct 07 12:28:49.915 2022 WARNING: pid 502051 tid 1669598: 2: 35:143906892: ArDBM::Caught ArcotException in _DbOp!. err : [Arcot Exception,Error: All database pools are inactive]
Fri Oct 07 12:28:49.915 2022 WARNING: pid 502051 tid 1669598: 8: 35:143906892: Could not fetch database time so using the system current time for processing the request.

===========================================================================================================================

 

Environment

Release : All supported AA releases.

Cause

Request For Information given the log lines in arcotriskfort.log

Resolution

Essentially DB connectivity from arcotriskfort is lost hence no access to the database is possible. Have picked some category of reported errors to explain.

=========================> These are Internal Errors 

Response[7001] Reason[8000]  

===========> No Active Database Operation like INSERT is possible
Fri Oct 07 12:28:48.973 2022 WARNING: pid 502051 tid 1669816: 8: 35:143906866: ARRF_LIB_InsertSysAuditLog. Inserting into ARRFSYSAUDITLOG FAILED. 

 

===========> No Active Database Pools are detected
Fri Oct 07 12:28:48.975 2022 WARNING: pid 502051 tid 1669816: 2: 35:143906867: ArDBM::Caught ArcotException in _DbOp!. err : [Arcot Exception,Error: All database pools are inactive]

===========> No Active Database Operation like FETCH is possible
Fri Oct 07 12:28:48.975 2022 WARNING: pid 502051 tid 1669816: 8: 35:143906867: Could not fetch database time so using the system current time for processing the request.


===========> No Active Database Operation like FETCH is possible --- AA uses Retrieve User request to check DB access
Fri Oct 07 12:28:49.527 2022 WARNING: pid 502051 tid 1670349: 2: 35:143906885: Error [ArDBM::Caught ArcotException in _DbOp!. err : [Arcot Exception,Error: All database pools are inactive]] occurred in retrieveUser for user [01908482516]

===========> No Active Database Operation like Audit Logging by UDS  is possible 
Fri Oct 07 12:28:49.527 2022 WARNING: pid 502051 tid 1670349: 2: 35:143906885: UDS Audit Log error: ArDBM::Caught ArcotException in _DbOp!. err : [Arcot Exception,Error: All database pools are inactive]
Fri Oct 07 12:28:49.527 2022 WARNING: pid 502051 tid 1670349: 2: 35:143906885: ArUDSException caught: Unknown Error

===========> Riskfort cannot get to Device Info 
Fri Oct 07 12:28:49.527 2022 WARNING: pid 502051 tid 1670349: 8: 35:143906885: fetchDeviceInfoForUser: Error occured while fetching DeviceIds. ArDBM::Caught ArcotException in _DbOp!. err : [Arcot Exception,Error: All database pools are inactive]

===========> Oracle Drivers  report all DB connection loss hence Timeouts reported

Fri Oct 07 12:28:50.053 2022 INFO:    pid 502051 tid 1670405: 2: 35:143906720: Dbm::SQL State:HYT00, Native Code: 7FF700000000, ODBC code: [CA AA][ODBC Oracle Wire Protocol driver]Timeout expired.SQL State:HYT00, Native Code: 7FF700000000, ODBC code: [CA AA][ODBC Oracle Wire Protocol driver]Timeout expired.

===========> The DB connectivity failure is reported --- All DB operations are failing. 
Fri Oct 07 12:28:50.053 2022 WARNING: pid 502051 tid 1670405: 2: 35:143906720: ArDBPoolManagerImpl::isKnownFailure: Error state [HYT00] is detected as known failure(type:0)!
Fri Oct 07 12:28:50.053 2022 WARNING: pid 502051 tid 1670405: 2: 35:143906720: ArDBPoolManagerImpl::reportQueryFailure: Query failure is detected as DBFO for primary DSN [arcotdsn] and context [29]. Marking it bad.Fri Oct 07 12:28:50.054 2022 WARNING: pid 502051 tid 1670405: 2: 35:143906720: UDS Audit Log error: ArDBM::Caught ArcotException in _DbOp!. err : [Arcot Exception,Error: All database pools are inactive]

=========================> These are Internal Errors 

Fri Oct 07 12:28:50.054 2022 INFO:    pid 502051 tid 1670405: 8: 35:143906720: Response[7664] Reason[8126] Error String [Internal Error:Database Operation Failed.]

===========> The DB connectivity failure is reported --- All DB operations are failing. Even DB time cannot be fetched from the database.

Fri Oct 07 12:28:49.915 2022 WARNING: pid 502051 tid 1669598: 8: 35:143906892: Could not fetch database time so using the system current time for processing the request.