Error: Migration failed after VM memory precopy. Please check vmkernel log for true error.

Products

• VMware vSphere ESXi

Issue/Introduction

Attempting to put a host into maintenance mode fails with the following symptoms:

• Virtual machines fail to vMotion off of or to the affected host
  
  
• You see the following error in vCenter
  
  
  • Error - Migration failed after VM memory precopy. Please check vmkernel log for true error.
filePath: /vmfs/volumes/########-########-####-############/<virtual machine name>/<virtual machine name>_1-rdmp.vmdk
lockMode: 0
mac: 00000000-00000000-0000-000000000000
The VM failed to resume on the destination during early power on.
Module Disk power on failed.
Cannot open the disk '/vmfs/volumes/########-########-####-############/<virtual machine name>/<virtual machine name>_1.vmdk' or one of the snapshot disks it depends on.
Failed to lock the file
File system specific implementation of OpenFile[file] failed
File system specific implementation of OpenFile[file] failed
File system specific implementation of OpenFile[file] failed
File system specific implementation of OpenFile[file] failed
File system specific implementation of OpenFile[file] failed
File system specific implementation of OpenFile[file] failed
File system specific implementation of Ioctl[file] failed
Locking conflict for file "/vmfs/volumes/########-########-####-############/<virtual machine name>/<virtual machine name>_1-rdmp.vmdk". VMFS on-disk lock owner is host with MAC address 00000000-00000000-0000-000000000000 and VMFS lock mode 0x0.


• In /var/log/vmkernel.log on the affected host you see:
  
  
  • YYYY-MM-DDTHH:MM:SS cpu28:2099675)Admission failure in path: host/iofilters/iofiltervpd:ioFilterVPServer.2099675:uw.2099675
YYYY-MM-DDTHH:MM:SS cpu28:2099675)UserWorld 'ioFilterVPServer' with cmdline '/usr/lib/vmware/iofilter/bin/ioFilterVPServer'
YYYY-MM-DDTHH:MM:SS cpu28:2099675)uw.2099675 (4996) extraMin/extraFromParent: 512/512, iofiltervpd (599) childEmin/eMinLimit: 6382/6400
    
    
• In /var/log/iofiltervpd.log on the affected host you see:
  
  
  • YYYY-MM-DDTHH:MM:SS iofiltervpd[2099675]: run:159:SSL Connection error 30 : SSL_ERROR_SSL error:2D071086:FIPS routines:FIPS_drbg_generate:selftest failederror:140B512D:SSL routines:ssl_get_new_session:ssl session id callback failed

Environment

• ESX 8.0.3 P06

Resolution

As a workaround, restart the IOFilterVP service:

1. SSH into the affected ESXi host
2. Restart the IOFilter service:
   
   /etc/init.d/iofiltervpd restart

Additional Information

Host goes in not-responding state due to ioFilterVP resource pool being out of memory