[VCDR] LWD based VM snapshot fails and crashes the VM

Products

• VMware Live Recovery

Issue/Introduction

To provide potential solution to snapshot failure and VM crash.
Issue noticed on VMware ESXi 7.0.3 Build:19482537

Symptoms:

LWD based snapshot fails for some VMs and VM crashes
VC event : LWD snapshot failed alert.
VC event : VMware ESX unrecoverable error: (worker-2935733) VERIFY bora/esx/apps/dp/iofilter/lwdSes.c:5134


The bellow error logs are noticed under vmx.log file.

Wa(03) filtPoll - IOFIPC: c3: Error on '152' while waiting for data to read: Connection reset by peer
Er(02) worker-2934497 - LWD: Failed to get a response for IPC client for request C489421A60 for disk C4289C86F0; error: Connection reset by peer
Wa(03) filtPoll - IOFIPC: c4: IPC client made no request, or could not write a request, before the timeout expired
Er(02) worker-2934749 - LWD: Failed to get a response for IPC client for request C489421A60 for disk C4289C86F0; error: Connection timed out
In(05) vcpu-0 - DISKLIB-LIB_BLOCKTRACK   : Resuming from change tracking info file /vmfs/volumes/07305f41-214ad5c3/TestVM/TestVM-ctk.vmdk.
Wa(03) filtPoll - IOFIPC: c5: Error on '152' while waiting for data to read: Connection reset by peer
Er(02) worker-2934497 - LWD: Failed to get a response for IPC client for request C489421A60 for disk C4289C86F0; error: Connection reset by peer
Wa(03) filtPoll - IOFIPC: c6: IPC client made no request, or could not write a request, before the timeout expired
Er(02) worker-2934497 - LWD: Failed to get a response for IPC client for request C489421A60 for disk C4289C86F0; error: Connection timed out
Wa(03) vcpu-0 - LWD: Error sending CloseDisk IPC to daemon for disk C4289C86F0: Connection timed out
In(05) vcpu-0 - LWD: Closed disk C4289C86F0

 

Cause

The IO Filter crashes while SES are half created, subsequent LWD operations fail when the filter attempts to open the old SES.

Resolution

The Issue has fixed on ESXi version 7.0u3o build 22348816 and above version.

Quick links
ESXI Build Number and Version: https://kb.vmware.com/s/article/2143832

 

Additional Information

Impact/Risks:

Unable to completed the Snapshot.
VM crash during the Snapshot.