Virtual machine backup snapshots are failing

Products

• VMware vSphere ESXi 7.0

Issue/Introduction

-Commvault backups are failing to finish or taking hours to complete

-Seeing the following error in the Commvault software when trying to take snapshots for backups:

```ErrorMessage[Modification not permitted. Unable to determine the state of the volume. This can be because of network connectivity problems or the volume is busy]}].```

-```esxtop``` is showing normal k/avg and d/avg

Environment

vCenter version=8.0.3, build=24322831

ESXi VMware ESXi 7.0.3 build-23307199

 Using NatApp NFS for storage

Commvault for backups

 

Cause

NetApp Engineering has determined the root cause of this issue is the “wafl.zombie.limit.aggr” option was set to 300 instead of the default 11300.

Resolution

Confirm with NetApp Support first.

On the NetApp Array:

 Run commands with diag privileges.

• ```set d -c off ; rows 0```

 Change the zombie limit to 11300. Please note the time you ran this command, as we will need it for perf archives.

• ```run * options wafl.zombie.limit.aggr 11300```

 Confirm that all nodes now report 11300.

• ```run * options wafl.zombie.limit.aggr```