VM backup jobs are failing because of VMs are moving from host to host during the backup job execution.
VMware vSphere 8.x
In the vSphere Client,
This will prevent DRS from automatically moving VMs between ESXi hosts. Refer to the following Documentation for further details on DRS configuration: Create a vSphere DRS Cluster - Machine Migration
NOTE: Best practice is to set DRS to fully automated so that vSphere can optimize the resource utilization across ESXi hosts in the cluster. Contact your backup software vendor for best practices in order to configure the backup software properly to operate in a vSphere environment.