RA FTPAGENT Runtime Exception in FTPES transfer mode

Products

• CA Automic Workload Automation - Automation Engine

Issue/Introduction

RA FTP jobs based on FTPES since they upgraded to 12.3.3.

The Problem comes up during tranfers from the local file system toward an FTPES Server on port 21.

The same jobs executed a immediately again can fail the first time and then complete the second time.

20210129/084001.842 - U02000005 Job 'JOBS.FTPAGENT.SVB.DWH.TO.OOEGKK.ASCII' with RunID '129829843' started.
20210129/084001.842 - U02000003 Job 'JOBS.FTPAGENT.SVB.DWH.TO.OOEGKK.ASCII' started with RunID '129829843'.
20210129/084007.038 - U02000009 Job 'JOBS.FTPAGENT.SVB.DWH.TO.OOEGKK.ASCII' with RunID '129829843' ended with return code '2'.
20210129/084007.641 - U02001026 Job 'JOBS.FTPAGENT.SVB.DWH.TO.OOEGKK.ASCII' with RunID '129829843' has been removed from the job table.
20210129/084036.753 - U02000005 Job 'JOBS.FTPAGENT.SVB.DWH.TO.OOEGKK.ASCII' with RunID '129831801' started.
20210129/084036.753 - U02000003 Job 'JOBS.FTPAGENT.SVB.DWH.TO.OOEGKK.ASCII' started with RunID '129831801'.
20210129/084041.900 - U02000009 Job 'JOBS.FTPAGENT.SVB.DWH.TO.OOEGKK.ASCII' with RunID '129831801' ended with return code '0'.
20210129/084042.026 - U02001026 Job 'JOBS.FTPAGENT.SVB.DWH.TO.OOEGKK.ASCII' with RunID '129831801' has been removed from the job table.

Whe the jobs abort we get the following java stack error in the in the JOB Report:

copy /home/ftp/svb/prod/out/ooegkk/STAMM.Z to /SVTraeger/svb/fokodata/STAMM.Z2021-01-29 08:42:10             
copy /home/ftp/svb/prod/out/ooegkk/STAMM.Z to /SVTraeger/svb/fokodata/STAMM.Z2021-01-29 08:42:10             
pool-1-thread-4: LocalFileSysBrowserImpl: start: getInputStream(): file: /home/ftp/svb/prod/out/ooegkk/STAMM.Z, skip: -12021-01-29 08:42:10             
pool-1-thread-4: LocalFileSysBrowserImpl: return: getInputStream(): [email protected] 08:42:10
pool-1-thread-4: FtpsCommandImpl: start: getOutputStream(): file: /SVTraeger/svb/fokodata/STAMM.Z, append: false2021-01-29 08:42:10
pool-1-thread-4: FtpFacadeCommandImpl: StackTrace: com.uc4.ftpjob.DataTransferException
at com.uc4.ftpjob.commands.FtpsCommandImpl.runCmd(FtpsCommandImpl.java:190)
at com.uc4.ftpjob.commands.FtpsCommandImpl.getOutputStream(FtpsCommandImpl.java:298)
at com.uc4.ftpjob.commands.FtpFacadeCommandImpl.getOutputStream(FtpFacadeCommandImpl.java:106)
at com.uc4.ftpjob.commands.impl.CopyCommand.execute(CopyCommand.java:601)
at com.uc4.ftpjob.commands.impl.CopyCommand.execute(CopyCommand.java:443)
at com.uc4.ftpjob.commands.CommandProcessor.execCommand(CommandProcessor.java:308)
at com.uc4.ftpjob.commands.CommandProcessor.processCommands(CommandProcessor.java:164)
at com.uc4.ftpjob.commands.CommandProcessor$processCommands$0.call(Unknown Source)
at FtpJob.runJob(FtpAgent.groovy:320)
at com.uc4.extensibility.types.CITAgent.dispatchJob(CITAgent.java:258)
at com.uc4.ex.cit.CITJob.execute(CITJob.java:195)
at com.uc4.ex.Job.run(Job.java:461)
at com.uc4.ex.ThreadPool$RunnableDecorator.run(ThreadPool.java:53)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)Caused by: java.io.IOException
at com.uc4.transfer.RAFTPSClient._prepareDataSocket_(RAFTPSClient.java:68)
at org.apache.commons.net.ftp.FTPSClient._openDataConnection_(FTPSClient.java:601)
at org.apache.commons.net.ftp.FTPClient._storeFileStream(FTPClient.java:688)
at org.apache.commons.net.ftp.FTPClient.__storeFileStream(FTPClient.java:679)
at org.apache.commons.net.ftp.FTPClient.storeFileStream(FTPClient.java:2007)
at com.uc4.ftpjob.commands.FtpsCommandImpl$10.runCommand(FtpsCommandImpl.java:302)
at com.uc4.ftpjob.commands.FtpsCommandImpl.runCmd(FtpsCommandImpl.java:171) ... 17 more
com.uc4.ftpjob.DataTransferException: General copy file exception.
at com.uc4.ftpjob.commands.impl.CopyCommand.throwDataException(CopyCommand.java:711)
at com.uc4.ftpjob.commands.impl.CopyCommand.execute(CopyCommand.java:680)
at com.uc4.ftpjob.commands.impl.CopyCommand.execute(CopyCommand.java:443)
at com.uc4.ftpjob.commands.CommandProcessor.execCommand(CommandProcessor.java:308)
at com.uc4.ftpjob.commands.CommandProcessor.processCommands(CommandProcessor.java:164)
at com.uc4.ftpjob.commands.CommandProcessor$processCommands$0.call(Unknown Source)
at FtpJob.runJob(FtpAgent.groovy:320)
at com.uc4.extensibility.types.CITAgent.dispatchJob(CITAgent.java:258)
at com.uc4.ex.cit.CITJob.execute(CITJob.java:195)
at com.uc4.ex.Job.run(Job.java:461)
at com.uc4.ex.ThreadPool$RunnableDecorator.run(ThreadPool.java:53)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)Caused by: java.lang.NullPointerException
at com.uc4.ftpjob.commands.FtpFacadeCommandImpl.throwDataException(FtpFacadeCommandImpl.java:55)
at com.uc4.ftpjob.commands.FtpFacadeCommandImpl.getOutputStream(FtpFacadeCommandImpl.java:109)
at com.uc4.ftpjob.commands.impl.CopyCommand.execute(CopyCommand.java:601) ... 14 more2021-01-29 08:42:10
Command aborted with error message: General copy file exception. null.2021-01-29 08:42:10
Job will continue to process commands.
++++++++++++++++++++++++++++++++++++++ End of Runtime Exception ++++++++++++++++++++++++++++++++++++++

 

Cause

This is a bug that will be corrected in a near version of the RA FTP Solution.

Environment

AE 12.3.3 
RA core 12.3.3
RA Solution 4.0.9+build.295
JRE: 1.8.0_121

Resolution

The bug is fixed in version 4.0.10 of the RA FTP Solution. Which is available since 29.04.21.