Introduction:
Monitor Event Processor failover with WCC alerts.
Background:
We can setup alert policies for failovers or get an alert on WCC monitoring tab when scheduler shuts down.
Environment:
CA WAAE 11.3.*
CA WCC 11.3.* and CA WCC 11.4
Instructions:
Create an Alert policy with the following alarms selected:
<Please see attached file for image>
This severity can be set as Critical
<Please see attached file for image>
Now kill the event_demon process to simulate a failover
ps -ef |grep event
autosys 65141 1 1 Mar23 ? 04:06:58 event_demon -A PRD
kill -9 65141
Run chk_auto_up to verify that the scheduler is not running
$ chk_auto_up
______________________________________________________________________________
CAUAJM_I_50054 Attempting (1) to Connect with Database: orcl.ca.com
CAUAJM_I_50055 *** Have Connected successfully with Database: orcl.ca.com. ***
______________________________________________________________________________
CAUAJM_I_50128 Connected with Event Server: orcl.ca.com
______________________________________________________________________________
CAUAJM_I_50054 Attempting (1) to Connect with Database: orcl1
CAUAJM_I_50055 *** Have Connected successfully with Database: orcl1. ***
______________________________________________________________________________
CAUAJM_I_50128 Connected with Event Server: orcl1
______________________________________________________________________________
______________________________________________________________________________
CAUAJM_I_50038 Checking CA WAAE Primary Scheduler on Machine: <hostname>
CAUAJM_I_50039 No Scheduler is RUNNING on machine: <hostname>
______________________________________________________________________________
CAUAJM_I_50038 Checking CA WAAE Shadow Scheduler on Machine: <hostname 2>
CAUAJM_I_50045 Shadow Scheduler is RUNNING on machine: <hostname 2>
______________________________________________________________________________
CAUAJM_I_50038 Checking CA WAAE Tie-Breaker Scheduler on Machine: <hostname 3>
CAUAJM_I_50047 Tie-Breaker Scheduler is RUNNING on machine: <hostname 3>
______________________________________________________________________________
Check the event_demon log in shadow for EP roll over
[04/06/2015 17:04:37] CAUAJM_I_40245 EVENT: ALARM ALARM: EP_ROLLOVER
[04/06/2015 17:04:37] <CAUAJM_W_40310 The shadow scheduler has taken over. The system is no
longer in high availability mode.>
Now we can check for the alert in WCC dashboard
<Please see attached file for image>
We can expand the alert to see the details
<Please see attached file for image>