Client Automation - Huge size file TRC_DTSAGENT_0.log on Unix Agents
search cancel

Client Automation - Huge size file TRC_DTSAGENT_0.log on Unix Agents

book

Article ID: 200748

calendar_today

Updated On:

Products

CA Client Automation - IT Client Manager CA Client Automation

Issue/Introduction

On Unix agents, the size of log TRC_DTSAGENT_*.log is huge (more than 1 GB).

And it contains a lot of time these errors :

dtsagent |dtsUDP_accept_co|pludpex.c      |001839|ERROR | (128) dtsUDP_accept_connection: Accept on socket <15> failed, error=<24>.
dtsagent |dtsDTSTCP_Check_|pltcp.c        |002913|ERROR | (128) DTSTCP_Check_For_Conns: Accept on socket <11> failed, error=<24>.
dtsagent |dtsUDPIPAG_accep|pludpex_ipag.c |002278|ERROR | (128) dtsUDPIPAG_accept_connection: Accept on socket <137443536> failed, error=<24>.
dtsagent |dtsUDPIPAG_accep|pludpex_ipag.c |002280|ERROR | accept failed

 

Environment

Client Automation - All Versions

 

Cause

dtsagent tries to send a Notify message to dtstos plugin (TOS) on Domain Manager

If CAM communication is not allowed between agent and Domain Manager, the sending of notification message is failing

 

dtsagent |dtsNOTIFY_SM_Tos|notify.c     |001654|DETAIL | notify_TOS=<TOS=<DomainTest:sm> >
dtsagent |cfOSServices    |cfOSServices |000000|INFO   | CCFOSGeneral::GetAddressFromNameEx: DomainTest resolved to: 192.2.3.4 2002:9f32:dddd::eeee:ffff
dtsagent |CFSMCAPI        |CFSMCAPI     |000000|WARNING| MsgDeliveryFailure : MSPICode 2 Sender was DTSDTA-NOTIFY
dtsagent |CFSMCAPI        |CFSMCAPI     |000000|WARNING| MsgDeliveryFailure : To: DomainTest\DTSTOS-R SR 0 TR 0 SI FFFFFF01 TI FFFFFF01
dtsagent |dtsNOTIFY_Handle|notify.c     |001604|WARNING| Notification message returned - failed to be delivered to <192.2.3.4>


DTS Agent tries to send again the notification message every 15 minutes.

After one attempt, 1 socket file remains opened and is not closed.

So there are 4 new socket files opened per hour. This is 96 opened files per day

After 10 or 11 days, the limit of 1024 files is reached and following error appear in the logs :

 

dtsagent |dtsUDP_accept_co|pludpex.c      |001839|ERROR | (128) dtsUDP_accept_connection: Accept on socket <15> failed, error=<24>.
dtsagent |dtsDTSTCP_Check_|pltcp.c        |002913|ERROR | (128) DTSTCP_Check_For_Conns: Accept on socket <11> failed, error=<24>.
dtsagent |dtsUDPIPAG_accep|pludpex_ipag.c |002278|ERROR | (128) dtsUDPIPAG_accept_connection: Accept on socket <137443536> failed, error=<24>.
dtsagent |dtsUDPIPAG_accep|pludpex_ipag.c |002280|ERROR | accept failed

 

Error 24 means "Too many open files"

 

Resolution

A solution is to disable the sending of Notification to TOS on dtsagent.

This could be done by using these commands :

caf stop dtsagent
sleep 30
caf kill dtsagent
rm -f $CA_ITRM_BASEDIR/logs/TRC_DTSAGENT_*.log
ccnfcmda -cmd SetParameterValue -ps itrm/dts/dtsagent -pn notifications -v 0
caf start dtsagent

 

This also could be done using an Asset Job of type Command with "Run only once" in scheduling options.

Powered by Wolken Software