When executing a script that accesses a directory on an AWS S3 mounted filesystem the script fails. The script and the commands executed manually have no issue.
The filesystems are mounted via the /etc/fstab and normal mount /umount commands.
The script fails when run by ESP but when run on the command line manually the script completes successfully.
This command fails when the script is executed by ESP
cd /delphi/s3_bucket2/Spark2/Cassandra/sku/$DIR*/
This command also fails in the job but executes successfully when the script is execute command line or the individual commands are execute command line.
export cnt=$( find /delphi/s3_bucket2/Spark2/Cassandra/sku/20230215*/* -type f | wc -l )
Release : All supported releases of ESP Workload Automation
The jobs can run on one of three servers. The job scripts and logging are on a common filesystem. So while only looking on one server you can see the output.
The job scripts where referencing a filesystem that was only setup on one of the three servers. The jobs failed when executed on one of the two servers that did not have the target filesystem mounted.
The filesystem was added to the other 2 servers, matching the first. The jobs will now execute on all three servers.