SFTP Jobs Fail or Experience Data Corruption on WA Agent r12.1 or Higher

Products

• ESP dSeries Workload Automation - Business Agents (dSeries)
• ESP dSeries Workload Automation - Scheduler (dSeries)
• ESP dSeries Workload Automation - System Agent (dSeries)
• Workload Automation Agent

Issue/Introduction

Users may observe the following issues with SFTP/SCP jobs after upgrading the Workload Automation System Agent to version r12.1, r24.1, or higher:

• SFTP download jobs fail to complete or hang.
• Files are transferred but contain binary corruption (e.g., missing bytes or single-byte errors appearing at regular 64 KB intervals).
• The ftp_scp_debug.log may show errors such as Incoming SFTP message... SshFxpStatus {id=..., code=5, message='Bad message'}.

Environment

• Product: Workload Automation System Agent (AutoSys, DE, ESP, dSeries)
• Versions: r12.1, r24.1, and higher
• Job Type: SFTP / SCP

Cause

In some instances transfer-layer issues can occur.  This can typically manifests as dropped bytes or corruption at 64 KB boundaries in the SFTP read path.

Resolution

To resolve this issue add the following parameters:

Stop the System Agent.

Navigate to the agent installation directory and open the agentparam.txt file.

Add (or modify) the following parameter:

ftp.scp.pipelinetransferenable=false
ftp.scp.pipelinewindowsize=8
ftp.scp.downloadblocksize=32750

Save the file.

Restart the System Agent.