ALARM: DB_PROBLEM TEXT: <CAUAJM_E_10619 Return values from dual database writes disagree. Databases may no longer be synchronized.

Products

• CA Workload Automation AE - Business Agents (AutoSys)
• CA Workload Automation AE - System Agent (AutoSys)
• CA Workload Automation AE - Scheduler (AutoSys)
• Workload Automation Agent
• Autosys Workload Automation

Issue/Introduction

Following messages are noticed in the logs, but we don't see any issue with DB's. They are both well synchronized.

[04/14/2020 10:02:31]      CAUAJM_I_40245 EVENT: ALARM            ALARM: DB_PROBLEM TEXT: <CAUAJM_E_10619 Return values from dual database writes disagree.  Databases may no longer be synchronized. ID[92] ESA[1] ESB[0]>
[04/14/2020 10:02:43]      CAUAJM_I_40245 EVENT: ALARM            ALARM: DB_PROBLEM TEXT: <CAUAJM_E_10619 Return values from dual database writes disagree.  Databases may no longer be synchronized. ID[92] ESA[1] ESB[0]>
[04/14/2020 10:03:08]      CAUAJM_I_40245 EVENT: ALARM            ALARM: DB_PROBLEM TEXT: <CAUAJM_E_10619 Return values from dual database writes disagree.  Databases may no longer be synchronized. ID[92] ESA[1] ESB[0]>
[04/14/2020 10:03:19]      CAUAJM_I_40245 EVENT: ALARM            ALARM: DB_PROBLEM TEXT: <CAUAJM_E_10619 Return values from dual database writes disagree.  Databases may no longer be synchronized. ID[92] ESA[1] ESB[0]>
[04/14/2020 10:03:29]      CAUAJM_I_40245 EVENT: ALARM            ALARM: DB_PROBLEM TEXT: <CAUAJM_E_10619 Return values from dual database writes disagree.  Databases may no longer be synchronized. ID[92] ESA[1] ESB[0]>
[04/14/2020 10:03:41]      CAUAJM_I_40245 EVENT: ALARM            ALARM: DB_PROBLEM TEXT: <CAUAJM_E_10619 Return values from dual database writes disagree.  Databases may no longer be synchronized. ID[92] ESA[1] ESB[0]>
[04/14/2020 10:03:51]      CAUAJM_I_40245 EVENT: ALARM            ALARM: DB_PROBLEM TEXT: <CAUAJM_E_10619 Return values from dual database writes disagree.  Databases may no longer be synchronized. ID[92] ESA[1] ESB[0]>
[04/14/2020 10:04:03]      CAUAJM_I_40245 EVENT: ALARM            ALARM: DB_PROBLEM TEXT: <CAUAJM_E_10619 Return values from dual database writes disagree.  Databases may no longer be synchronized. ID[92] ESA[1] ESB[0]>
[04/14/2020 10:06:41]      CAUAJM_I_40245 EVENT: ALARM            ALARM: DB_PROBLEM TEXT: <CAUAJM_E_10619 Return values from dual database writes disagree.  Databases may no longer be synchronized. ID[92] ESA[1] ESB[0]>

 

Environment

Release : 11.3.6

Component : CA Workload Automation AE (AutoSys)

Resolution

1. Shutdown the AutoSys services (both server and scheduler) on both primary and shadow servers.
2. Run reconcile_comm_ora_noupdate.sql located in $AUTOSYS/dbobj/ORA folder if database being used is Oracle.
   If the output of the sql script returns below message, then you will have to run reconcile_comm_ora.sql to fix the data.
            USER ACTION: RE-RUN *** DETECTED NEW CONFLICTING ROWS AFTER THIS ITERATION. PLEASE EXECUTE THE RECONCILE SCRIPT TO UPDATE THE TABLE. ***
3. Run the reconcile_comm_ora.sql script located in $AUTOSYS/dbobj/ORA folder if database being used is Oracle.
   When running reconcile script, you may have to run it multiple times based on final output of the reconcile script, if you see below message then you will have to run it again:
            USER ACTION: RE-RUN *** DETECTED NEW CONFLICTING ROWS AFTER THIS ITERATION. PLEASE EXECUTE THIS SCRIPT ONCE MORE TO RESOLVE! ***
4. The reconcile process is complete when you no longer encounter the messages show in bold red font above. Restart AutoSys services on both Primary and Shadow servers to restore service.

IMPORTANT: The AutoSys services must be down on both Primary and Shadow servers!!