Zombie process in Linux agent
search cancel

Zombie process in Linux agent

book

Article ID: 84406

calendar_today

Updated On:

Products

CA Automic Workload Automation - Automation Engine

Issue/Introduction

Error Message :
[v12@lnx01 bin]$ ps -ef|grep $PWD
root 18723 17564 0 11:02 pts/1 00:00:00 /opt/automic/v12u/agents/linux/bin/ucxjlx6
v12 18739 1 0 11:03 ? 00:00:00 /opt/automic/v12u/agents/linux/bin/./ucxjlx6s -s 37249 -u v12 -trc 9 -trcpath /opt/automic/v12u/agents/linux/temp -maxidle 600
v12 18743 1 0 11:03 ? 00:00:00 /opt/automic/v12u/agents/linux/bin/./ucxjlx6s -s 25567 -u v12 -trc 9 -trcpath /opt/automic/v12u/agents/linux/temp -maxidle 600
v12 18747 1 0 11:03 ? 00:00:00 /opt/automic/v12u/agents/linux/bin/./ucxjlx6s -s 55608 -u v12 -trc 9 -trcpath /opt/automic/v12u/agents/linux/temp -maxidle 600
v12 19284 17564 0 11:13 pts/1 00:00:00 grep --color=auto /opt/automic/v12u/agents/linux/bin

Start two events (5 times each) --> the wrong directory name is on purpose

[v12@lnx01 bin]$
ps -ef|grep $PWD

root     18723 17564  0 11:02 pts/1    00:00:00 /opt/automic/v12u/agents/linux/bin/ucxjlx6
v12      18739     1  0 11:03 ?        00:00:00 /opt/automic/v12u/agents/linux/bin/./ucxjlx6s -s 37249 -u v12 -trc 9 -trcpath /opt/automic/v12u/agents/linux/temp -maxidle 600
v12      18743     1  0 11:03 ?        00:00:00 /opt/automic/v12u/agents/linux/bin/./ucxjlx6s -s 25567 -u v12 -trc 9 -trcpath /opt/automic/v12u/agents/linux/temp -maxidle 600
v12      18747     1  0 11:03 ?        00:00:00 /opt/automic/v12u/agents/linux/bin/./ucxjlx6s -s 55608 -u v12 -trc 9 -trcpath /opt/automic/v12u/agents/linux/temp -maxidle 600
v12      18759 17564  0 11:03 pts/1    00:00:00 grep --color=auto /opt/automic/v12u/agents/linux/bin


total 5376
-rw-r--r-- 1 v12 v12   26507 Dec  8 11:04 ucxjxxx_l00.txt
-rw-r--r-- 1 v12 v12 3595963 Dec  8 11:05 ucxjxxx_t00.txt
-rw-rw-r-- 1 v12 v12   25095 Dec  8 11:05 iostrc-00018743.txt
-rw-rw-r-- 1 v12 v12   28551 Dec  8 11:05 iostrc-00018739.txt
-rw-rw-r-- 1 v12 v12   28569 Dec  8 11:05 iostrc-00018747.txt


 Event
          Event ID    1378559
          Host    LNX01_LINUX
          Path    /opt/opt/opt/*.*
          Next check    12/8/2017 11:06:17 AM
          Last check    12/8/2017 11:05:26 AM
          Check count    5
          Event count    0

          
Stopped the events at  End    12/8/2017 11:07:02 AM

[v12@lnx01 bin]$
date
Fri Dec  8 11:07:18 PST 2017
 
[v12@lnx01 bin]$ ps -ef|grep $PWD
root     18723 17564  0 11:02 pts/1    00:00:00 /opt/automic/v12u/agents/linux/bin/ucxjlx6
v12      18739     1  0 11:03 ?        00:00:00 /opt/automic/v12u/agents/linux/bin/./ucxjlx6s -s 37249 -u v12 -trc 9 -trcpath /opt/automic/v12u/agents/linux/temp -maxidle 600
v12      18743     1  0 11:03 ?        00:00:00 /opt/automic/v12u/agents/linux/bin/./ucxjlx6s -s 25567 -u v12 -trc 9 -trcpath /opt/automic/v12u/agents/linux/temp -maxidle 600
v12      18747     1  0 11:03 ?        00:00:00 /opt/automic/v12u/agents/linux/bin/./ucxjlx6s -s 55608 -u v12 -trc 9 -trcpath /opt/automic/v12u/agents/linux/temp -maxidle 600
v12      19076 17564  0 11:07 pts/1    00:00:00 grep --color=auto /opt/automic/v12u/agents/linux/bin

[v12@lnx01 temp]$ ls -ltr
total 9664
-rw-r--r-- 1 v12 v12   36867 Dec  8 11:08 ucxjxxx_l00.txt
-rw-r--r-- 1 v12 v12 7979359 Dec  8 11:10 ucxjxxx_t00.txt
-rw-rw-r-- 1 v12 v12   73976 Dec  8 11:10 iostrc-00018743.txt
-rw-rw-r-- 1 v12 v12   76861 Dec  8 11:10 iostrc-00018739.txt
-rw-rw-r-- 1 v12 v12   91277 Dec  8 11:10 iostrc-00018747.txt

[v12@lnx01 bin]$ ps -ef|grep $PWD
root     18723 17564  0 11:02 pts/1    00:00:00 /opt/automic/v12u/agents/linux/bin/ucxjlx6
v12      18739     1  0 11:03 ?        00:00:00 /opt/automic/v12u/agents/linux/bin/./ucxjlx6s -s 37249 -u v12 -trc 9 -trcpath /opt/automic/v12u/agents/linux/temp -maxidle 600
v12      18743     1  0 11:03 ?        00:00:00 /opt/automic/v12u/agents/linux/bin/./ucxjlx6s -s 25567 -u v12 -trc 9 -trcpath /opt/automic/v12u/agents/linux/temp -maxidle 600
v12      18747     1  0 11:03 ?        00:00:00 /opt/automic/v12u/agents/linux/bin/./ucxjlx6s -s 55608 -u v12 -trc 9 -trcpath /opt/automic/v12u/agents/linux/temp -maxidle 600
v12      19284 17564  0 11:13 pts/1    00:00:00 grep --color=auto /opt/automic/v12u/agents/linux/bin

 
Stop the agent --> the file events are closed
 
[v12@lnx01 bin]$ sudo kill -9 18723
[1]+  Killed                  nohup $PWD/ucxjlx6
[v12@lnx01 bin]$ ps -ef|grep $PWD
v12      19297 17564  0 11:14 pts/1    00:00:00 grep --color=auto /opt/automic/v12u/agents/linux/bin

Environment

OS Version: Any Linux OS

Cause

Cause type:
By design
Root Cause: By default the spawned IO service process will be alive for at least 10 minutes.

Resolution

By default the spawned IO service process will be alive at least for 10 minutes. 

After launching events wait at least 10 minutes before launching any new events until the child processes disappear.

 

Fix Version(s):
N/A

Additional Information

Workaround :
Run a Linux command Kill -9 to kill the zombie process.