ORA-25226: dequeue failed, queue APPWORX_PROD.RMI_PIPE12345678 is not enabled for dequeue

Products

• CA Automic Applications Manager (AM)

Issue/Introduction

After upgrading to Applications Manager 9.6 or 9.6.1, the following error may be seen in an RmiServer pop up error or when starting the RmiServer process.

The RmiServer process may fail to start or Job process may stop when this error is seen.

ORA-20999: Scheduling has encountered an exception - Scheduling will not continue until issue is resolved - 
[ORA-20001: Submit_chains so_sch_seq=19557-[ORA-25226: dequeue failed, queue APPWORX_PROD.RMI_PIPE12345678 is not enabled for dequeue
ORA-06512: at "APPWORX.AM_AQ", line 384
ORA-06512: at "SYS.DBMS_AQ", line 990
ORA-06512: at "APPWORX.AM_AQ", line 339
ORA-06512: at "APPWORX.AWAPI3", line 3592
ORA-06512: at "APPWORX.AWAPI3", line 3592
ORA-06512: at "APPWORX.AWAPI3", line 3570
ORA-06512: at "APPWORX.SQLOPER_SOJOBQUEUE", line 545
ORA-04088: error during execution of trigger 'APPWOR]
ORA-06512: at "APPWORX.AW_TIMEZONES", line 2453
ORA-06512: at "APPWORX.AW_TIMEZONES", line 2177
ORA-06512: at "APPWORX.AW5", line 2331
ORA-06512: at "APPWORX.AW5", line 2336
ORA-06512: at line 1

Environment

Applications Manager 9.6 and 9.6.1

Cause

defect in AQ code

Resolution

A fix will be included in Applications Manager version 9.6.2 and/or 9.7

Workaround for 9.6 and 9.6.1:

Fixes can be applied by running two sql scripts that are attached to this article, am_aq_aq_fix.sql and aw_operation_body_aq_fix.sql.

1. Download attached aq_fix.zip
2. Extract am_aq_aq_fix.sql and aw_operation_body_aq_fix.sql from zip and move to the master's $AW_HOME/sql directory
3. Stop Applications Manager processes
4. From the $AW_HOME/sql directory, run a sqlplus command and connect to the AM database as the AM Oracle User
5. Run the commands from the sqlplus command line and exit:
   
   @am_aq_aq_fix.sql
   @aw_operation_body_aq_fix.sql
   @aw_post_checks.sql  (this already exist in sql directory and needs to run after the above to recreate AQ)
   
   
6. Restart Applications Manager processes

To revert changes:

From the same sql directory, follow the same steps replacing the commands with the below commands:

1. @am_aq.sql
2. @aw_operation_body.sql
3. @aw_post_checks.sql  (this already exist in sql directory and needs to run after the above to recreate AQ)

Additional Information

This sql update is a cumulative fix/improvement for multiple reported/observed issues. See KE(s) below: 

Slowness in Backlog Job status changes