Zombie process in Linux agent

book

Article ID: 84406

calendar_today

Updated On:

Products

CA Automic Workload Automation - Automation Engine AUTOMIC WORKLOAD AUTOMATION

Issue/Introduction

Error Message :
[[email protected] bin]$ ps -ef|grep $PWD
root 18723 17564 0 11:02 pts/1 00:00:00 /opt/automic/v12u/agents/linux/bin/ucxjlx6
v12 18739 1 0 11:03 ? 00:00:00 /opt/automic/v12u/agents/linux/bin/./ucxjlx6s -s 37249 -u v12 -trc 9 -trcpath /opt/automic/v12u/agents/linux/temp -maxidle 600
v12 18743 1 0 11:03 ? 00:00:00 /opt/automic/v12u/agents/linux/bin/./ucxjlx6s -s 25567 -u v12 -trc 9 -trcpath /opt/automic/v12u/agents/linux/temp -maxidle 600
v12 18747 1 0 11:03 ? 00:00:00 /opt/automic/v12u/agents/linux/bin/./ucxjlx6s -s 55608 -u v12 -trc 9 -trcpath /opt/automic/v12u/agents/linux/temp -maxidle 600
v12 19284 17564 0 11:13 pts/1 00:00:00 grep --color=auto /opt/automic/v12u/agents/linux/bin

Start two events (5 times each) --> the wrong directory name is on purpose

[[email protected] bin]$
ps -ef|grep $PWD
root     18723 17564  0 11:02 pts/1    00:00:00 /opt/automic/v12u/agents/linux/bin/ucxjlx6
v12      18739     1  0 11:03 ?        00:00:00 /opt/automic/v12u/agents/linux/bin/./ucxjlx6s -s 37249 -u v12 -trc 9 -trcpath /opt/automic/v12u/agents/linux/temp -maxidle 600
v12      18743     1  0 11:03 ?        00:00:00 /opt/automic/v12u/agents/linux/bin/./ucxjlx6s -s 25567 -u v12 -trc 9 -trcpath /opt/automic/v12u/agents/linux/temp -maxidle 600
v12      18747     1  0 11:03 ?        00:00:00 /opt/automic/v12u/agents/linux/bin/./ucxjlx6s -s 55608 -u v12 -trc 9 -trcpath /opt/automic/v12u/agents/linux/temp -maxidle 600
v12      18759 17564  0 11:03 pts/1    00:00:00 grep --color=auto /opt/automic/v12u/agents/linux/bin


total 5376
-rw-r--r-- 1 v12 v12   26507 Dec  8 11:04 ucxjxxx_l00.txt
-rw-r--r-- 1 v12 v12 3595963 Dec  8 11:05 ucxjxxx_t00.txt
-rw-rw-r-- 1 v12 v12   25095 Dec  8 11:05 iostrc-00018743.txt
-rw-rw-r-- 1 v12 v12   28551 Dec  8 11:05 iostrc-00018739.txt
-rw-rw-r-- 1 v12 v12   28569 Dec  8 11:05 iostrc-00018747.txt


 Event
          Event ID    1378559
          Host    VWAF1LNX01_LINUX
          Path    /opt/opt/opt/*.*
          Next check    12/8/2017 11:06:17 AM
          Last check    12/8/2017 11:05:26 AM
          Check count    5
          Event count    0

          
Stopped the events at  End    12/8/2017 11:07:02 AM

[[email protected] bin]$
date
Fri Dec  8 11:07:18 PST 2017
 
[[email protected] bin]$ ps -ef|grep $PWD
root     18723 17564  0 11:02 pts/1    00:00:00 /opt/automic/v12u/agents/linux/bin/ucxjlx6
v12      18739     1  0 11:03 ?        00:00:00 /opt/automic/v12u/agents/linux/bin/./ucxjlx6s -s 37249 -u v12 -trc 9 -trcpath /opt/automic/v12u/agents/linux/temp -maxidle 600
v12      18743     1  0 11:03 ?        00:00:00 /opt/automic/v12u/agents/linux/bin/./ucxjlx6s -s 25567 -u v12 -trc 9 -trcpath /opt/automic/v12u/agents/linux/temp -maxidle 600
v12      18747     1  0 11:03 ?        00:00:00 /opt/automic/v12u/agents/linux/bin/./ucxjlx6s -s 55608 -u v12 -trc 9 -trcpath /opt/automic/v12u/agents/linux/temp -maxidle 600
v12      19076 17564  0 11:07 pts/1    00:00:00 grep --color=auto /opt/automic/v12u/agents/linux/bin

[[email protected] temp]$ ls -ltr
total 9664
-rw-r--r-- 1 v12 v12   36867 Dec  8 11:08 ucxjxxx_l00.txt
-rw-r--r-- 1 v12 v12 7979359 Dec  8 11:10 ucxjxxx_t00.txt
-rw-rw-r-- 1 v12 v12   73976 Dec  8 11:10 iostrc-00018743.txt
-rw-rw-r-- 1 v12 v12   76861 Dec  8 11:10 iostrc-00018739.txt
-rw-rw-r-- 1 v12 v12   91277 Dec  8 11:10 iostrc-00018747.txt

[[email protected] bin]$ ps -ef|grep $PWD
root     18723 17564  0 11:02 pts/1    00:00:00 /opt/automic/v12u/agents/linux/bin/ucxjlx6
v12      18739     1  0 11:03 ?        00:00:00 /opt/automic/v12u/agents/linux/bin/./ucxjlx6s -s 37249 -u v12 -trc 9 -trcpath /opt/automic/v12u/agents/linux/temp -maxidle 600
v12      18743     1  0 11:03 ?        00:00:00 /opt/automic/v12u/agents/linux/bin/./ucxjlx6s -s 25567 -u v12 -trc 9 -trcpath /opt/automic/v12u/agents/linux/temp -maxidle 600
v12      18747     1  0 11:03 ?        00:00:00 /opt/automic/v12u/agents/linux/bin/./ucxjlx6s -s 55608 -u v12 -trc 9 -trcpath /opt/automic/v12u/agents/linux/temp -maxidle 600
v12      19284 17564  0 11:13 pts/1    00:00:00 grep --color=auto /opt/automic/v12u/agents/linux/bin

 
Stop the agent --> the file events are closed
 
[[email protected] bin]$ sudo kill -9 18723
[1]+  Killed                  nohup $PWD/ucxjlx6
[[email protected] bin]$ ps -ef|grep $PWD
v12      19297 17564  0 11:14 pts/1    00:00:00 grep --color=auto /opt/automic/v12u/agents/linux/bin

Cause

Cause type:
By design
Root Cause: By default the spawned IO service process will be alive for at least 10 minutes.

Environment

OS Version: N/A

Resolution

By default the spawned IO service process will be alive at least for 10 minutes. 

After launching events wait at least 10 minutes before launching any new events until the child processes disappear.

 

Fix Version(s):
N/A

Additional Information

Workaround :
Run a Linux command Kill -9 to kill the zombie process.