gpbackup freezing with "Pipe not found" error on Azure GPDB cluster

Products

• VMware Tanzu Greenplum

Issue/Introduction

The gpbackup process freezes, with an error like the one below appearing in pg_log or GPCC: 

command error message: Pipe not found /data/primary/gpseg02/gpbackup_2_20231120210006_pipe_27143_2058451 (seg2 10.10.10.10:3000 pid=28310)

This is specifically seen on an Azure cluster.

Environment

Product Version: 6.21

Resolution

Issue was with the service used to mount Azure blob storage in Linux (in this case, Blobfuse). The service had the correct permissions to create/modify files on the master/coordinator host, but not the segment hosts. 

Check with the mount service to see if the correct permissions are given for file creation/modification.