Remote Agent fails to start receive AwE-5103 and Agents java awapi time out errors

Products

• CA Automic Applications Manager (AM)

Issue/Introduction

Error Message :
ErrorMsg: AwE-5103 network socket error
Details: XX.XX.X.XX:49153
network socket error : XX.XX.XXX.XX:49153 : java.net.ConnectException:

Remote Agent fails to start and the above error message is seen in AgentService log on the Remote Agent's machine.
 

 AgentService: .AwComm: lookup 49153 Y XX.XX.X.XX
 AgentService: .AgentService: createSocket: XX.XX.X.XX:49153 From HOSTNAME/YY.YY.Y.YY:49175 encrypt true
 AgentService: .AgentService: using sun ssl
 AgentService: AwE-5103
 AgentService: .AxOptions: NoErrorMsgProperties=false
ErrorMsg: AwE-5103 network socket error 
Details: XX.XX.X.XX:49153
network socket error : XX.XX.X.XX:49153 : java.net.ConnectException: Connection refused

Other Remote Agents remain running, and jobs are executing successfully.  

Investigation

1. Confirm that the awcomm process is able to connect by reviewing the logs.
2. Verify the information in the $AW_HOME/data/net_con.dat file to ensure it is correct.
3. Look at the AgentService process on the Master, since this is the next step in a Master/Remote Agent connection.
4. Check to see that the process is running by issuing:

     Unix/Linux
          ps -ef |grep <AM user> 
     or
          ck (only if you are logged in as the AM user on the Remote Agent and have executed the sosite file)
     Windows
          Task Manager and look for any processes running for the Remote Agent

    Kill/Terminate any AM-related processes that are still running on the Remote Agent.

5. Use the 'netstat' command to check any connections from the Remote Agent machine to see if it is connected to the IP of the Master.

netstat | grep <Master's IP>

If there are any connections to the Master machine's 'awcomm' or 'MasterServer' port, go ahead and kill them.   

6. Ensure that there is an AgentService log present on the Master machine.  If it does not exist, stop and restart the AgentService process. 

The AgentService process should start and successfully run Jobs.  If it does not, open a case with Support.

 

Environment

CA Automic Applications Manager 9.4x, 9.5x

Cause

Environment Issue.

Resolution

Workaround :

Stop and restart the AgentService process on the master. Once restarted you will need to stop and restart remote agents. The AgentService process should start and successfully run Jobs.  If it does not, open a case with Support.

Refer to the "Description" or "Workaround" sections for complete troubleshooting steps.