vMotion failing on certain VMs. Error: "failed to lookup swapfile: Failure."

Products

• VMware SDDC Manager
• VMware vCenter Server 8.0
• VMware vCenter Server 7.0

Issue/Introduction

vMotion failing on certain VMs. Error: "failed to lookup swapfile: Failure."

vMotion hanging for a long time before finally failing with the error above

Errors seen :

Failed waiting for data. Error 195887167. Connection closed by remote host, possibly due to timeout.

"Failed waiting for data. Error 195887167. Connection closed by remote host, possibly due to timeout. YYYY-MM-DDTHH:MM:SSZ VMotionStream [-######:#########] failed to lookup swapfile: Failure. Migration to host <###.###.###.###> failed with error Failure (195887105). YYYY-MM-DDTHH:MM:SSZ vMotion migration [--######:#########] failed to read stream keepalive: Connection closed by remote host, possibly due to timeout"

Environment

VMware vCenter Server

VMware SDDC Manager

Cause

The cause of this is still unknown at this stage.

VMware Engineering are continuing to investigate the issue.

Resolution

Currently the only resolution is to reboot the impacted VM(s)

Rebooting VM recreates the .vswp file and allows VM to migrate. 

 

Confirm the issue by checking the errors in the VC GUI match those above and then from the ESXi logs

hostd.log
=========
YYYY-MM-DDTHH:MM:SSZ Db(167) Hostd[2102871]: --> Migration to host <ESXi-FQDN-OR-IP> failed with error Failure (0xbad0001).
YYYY-MM-DDTHH:MM:SSZ Db(167) Hostd[2102871]: -->
YYYY-MM-DDTHH:MM:SSZ Wa(164) Hostd[2102877]: [Originator@6876 sub=Vmsvc.vm:/vmfs/volumes/vsan:<vSAN-DATASTORE>/<VM-NAME>.vmx] Failed to find activation record, event user unknown.
YYYY-MM-DDTHH:MM:SSZ In(166) Hostd[2102877]: [Originator@6876 sub=Vimsvc.ha-eventmgr] Event 4767595 : Error message on <VM-NAME> on ESXi-FQDN-OR-IP.MYDOMAIN.COM in ha-datacenter: Migration to host <ESXi-FQDN-OR-IP> failed with error Failure (195887105).

YYYY-MM-DDTHH:MM:SSZ Db(167) Hostd[2102902]: [Originator@6876 sub=Vigor.Vmsvc.vm:/vmfs/volumes/vsan:<vSAN-DATASTORE>/<VM-NAME>.vmx] VMotionInitiateSrc: Start message: Migration to host <ESXi-FQDN-OR-IP> failed with error Failure (0xbad0001).
YYYY-MM-DDTHH:MM:SSZ Db(167) Hostd[2102871]: --> VMotionStream [c0a8150c:690742357087270928] failed to lookup swapfile: Failure.

 

vmware.log
==========
YYYY-MM-DDTHH:MM:SSZ In(05) vmx - [msg.migrate.waitdata.platform] Failed waiting for data.  Error bad003f. Connection closed by remote host, possibly due to timeout.
YYYY-MM-DDTHH:MM:SSZ In(05) vmx - [vob.vmotion.stream.keepalive.read.fail] VMotionStream [c0a8150c:690742357087270928] failed to read stream keepalive: Connection closed by remote host, possibly due to time