Running scripts through ESP where the script accesses mounted AWS S3 bucket. The jobs fail and commands fail

Products

• ESP Workload Automation

Issue/Introduction

When executing a script that accesses a directory on an AWS S3 mounted filesystem the script fails. The script and the commands executed manually have no issue. 

The filesystems are mounted via the /etc/fstab and normal mount /umount commands.

The script fails when run by ESP but when run on the command line manually the script completes successfully.

This command fails when the script is executed by ESP

cd /delphi/s3_bucket2/Spark2/Cassandra/sku/$DIR*/

This command also fails in the job but executes successfully when the script is execute command line or the individual commands are execute command line.

export cnt=$( find /delphi/s3_bucket2/Spark2/Cassandra/sku/20230215*/* -type f | wc -l )

 

 

 

 

 

 

Environment

Release : All supported releases of ESP Workload Automation

Cause

The jobs can run on one of three servers. The job scripts and logging are on a common filesystem. So while only looking on one server you can see the output.

The job scripts where referencing a filesystem that was only setup on one of the three servers. The jobs failed when executed on one of the two servers that did not have the target filesystem mounted.  

Resolution

The filesystem was added to the other 2 servers, matching the first. The jobs will now execute on all three servers.