Unable to perform storage vMotion, disk consolidation, and deletion of snapshots on running VMs on Netapp NFSv3 Storage

Products

• VMware vCenter Server
• VMware vSphere ESXi

Issue/Introduction

Symptoms:

• Unable to perform storage vMotion, disk consolidation, deletion of snapshots
• When attempting to consolidate, task fails with error: "Failed to fetch disk size"
• During snapshot consolidation, you may see the following log messages:

vmware.log

[YYYY-MM-DDTHH:MM:SS] Er(02) vmx lniqbyyf-19001-auto-enu-h5:70009024-1-f7-19a2 DISKLIB-LINK  : DiskLinkGetSize: Failed to get extent size: Unknown error
[YYYY-MM-DDTHH:MM:SS] Er(02) vmx lniqbyyf-19001-auto-enu-h5:70009024-1-f7-19a2 ConsolidateFillSnapDiskTransferArray: Failed to fetch disk size of '/vmfs/volumes/x1x51x40-xxx417x1/<VM Name>/<VM Name>-000001.vmdk' for consolidate: Unknown error (5)
[YYYY-MM-DDTHH:MM:SS] In(05) vmx lniqbyyf-19001-auto-enu-h5:70009024-1-f7-19a2 ConsolidateStart: Failure while populating the snapDataPerCombineOperation array: 'Unknown error' (5)
[YYYY-MM-DDTHH:MM:SS] In(05) vmx lniqbyyf-19001-auto-enu-h5:70009024-1-f7-19a2 ConsolidateEnd: Snapshot consolidate complete: Unknown error (5).

syslog.log
[YYYY-MM-DDTHH:MM:SS] Er(11) vaainasd[2099172]: DISKLIB-PLUGIN :: Skip marking NULL mapping entries as stale, diff of last stale check time: 462 sec is less than expectedcycle.
[YYYY-MM-DDTHH:MM:SS] Er(11) vaainasd[2099172]: DISKLIB-PLUGIN : :[vendor_nas_plugin : /vmfs/volumes/x1x51x40-xxx417x1] : Extended stats failed:[/vmfs/volumes/x1x51x40-xxx417x1/<VM Name>/<VM Name>_2-flat.vmdk], Error: Unknown error.
[YYYY-MM-DDTHH:MM:SS] Er(11) vaainasd[2099172]: DISKLIB-PLUGIN :: Skip priting per plugin stat summary, time gap between last print cycle and current is less than :3600 sec.
[YYYY-MM-DDTHH:MM:SS] Er(11) vaainasd[2099172]: DISKLIB-PLUGIN :: Skip marking NULL mapping entries as stale, diff of last stale check time: 462 sec is less than expectedcycle.
.
.
.
[YYYY-MM-DDTHH:MM:SS] In(14) vaainasd[2099172]: DISKLIB-PLUGIN :: VAAI-NAS:: vendor_nas_plugin: SUCCESSES: RsrvSpace [0] Cln-Full [0]Cln-Lazy [0] cln-DRun [0], Ext-stats [0].
[YYYY-MM-DDTHH:MM:SS] In(14) vaainasd[2099172]: DISKLIB-PLUGIN :: VAAI-NAS:: vendor_nas_plugin: FAILURES: RsrvSpace [0] Cln-Full [0]Cln-Lazy [0] cln-DRun [0], Ext-stats [9783].

Cause

The error comes from the 3rd party NetApp VAAI-NAS plugin.

Resolution

The NetApp VAAI plugin requires both NFS3 and NFS4 protocols to be enabled on the NetApp side. Please refer to the following NetApp KB for further information.

[NetApp KB] Configuring export policies for ONTAP to allow VAAI over NFS