Schedules are no longer working

Products

• CA Automic Applications Manager (AM)

Issue/Introduction

Schedules are no longer working and the following error is reported in an RmiServer pop-up or the latest RmiServer<timestamp>.log in the Master's $AW_HOME/log directory:

ErrorMsg: AwE-5001 Database Query Error
Details: ORA-20999: Scheduling has encountered an exception - Scheduling will not continue until issue is resolved - [ORA-20001: Submit_chains so_sch_seq=17370--ORA-00001: unique constraint (AM.SO_JOB_QUEUE_IDX2) violated]
ORA-06512: at "AM.AW5", line 1984
ORA-06512: at line 1
..
aw5.submit_chains

Environment

Applications Manager version 9.5.x, 9.6.x

Resolution

Correct the issue by re-ordering the Process Flow and/or Schedule sequence numbers to allow scheduling to continue.

1. Log into sqlplus as the Oracle Applications Manager User and run the following sql:
   
   select jt.so_module, sch.aw_sch_name from aw_module_sched sch, so_job_table jt where sch.aw_job_seq = jt.so_job_seq and sch.aw_sch_seq = <seq num>;
   
   Replace <seq num> with the so_sch_seq value from the error message (e.g 17370 in the example error message above)
   
   This should return a Job or Process Flow name.
   
   
2. Edit the Schedule associated with that Process Flow and make any  change, hit Apply, reverse the change and Apply once more.
   
   
3. Make a change on the Process Flow, hit Apply, reverse the change and Apply once more.
   
   
4. Clear the RmiServer error by selecting View > Clear RmiServer Errors