Symptoms:
When creating virtual machine backups using quiescent snapshots, you experience these symptoms:
Another operation is in progress.
Protocol error from VMX
vmware.log
file for the virtual machine shows continued logging:vcpu-0| TOOLS: backup event set in VMDB (req.keepAlive 0 )
vcpu-0| TOOLS: backup event set in VMDB (req.keepAlive 0 )
vcpu-0| TOOLS: backup event set in VMDB (req.keepAlive 0 )
vcpu-0| TOOLS: backup event set in VMDB (req.keepAlive 0 )
vcpu-0| TOOLS: backup event set in VMDB (req.keepAlive 0 )
hostd
log file for the respective ESX host logs events indicating that the event queue is full. For example:F6468B90 warning 'vm:/vmfs/volumes/4a68bc23-4510a5f3-####-##########42/VM-1/VM-1.vmx'] BackupAgentImpl: evicting event due to full queue (keepAlive)
F63A5B90 warning 'vm:/vmfs/volumes/4a68bc23-4510a5f3-####-##########42/VM-2/VM-2.vmx'] BackupAgentImpl: evicting event due to full queue (keepAlive)
F6364B90 warning 'vm:/vmfs/volumes/4a35051f-40bf72e2-####-##########10/VM-3/VM-3.vmx'] BackupAgentImpl: evicting event due to full queue (keepAlive)
F6468B90 warning 'vm:/vmfs/volumes/4a68bc23-4510a5f3-####-##########42/VM-4/VM-4.vmx'] BackupAgentImpl: evicting event due to full queue (keepAlive)
F66136D0 verbose 'vm:/vmfs/volumes/4a68bc23-4510a5f3-####-##########42/VM-5/VM-5.vmx'] Quiesced snapshot backup agent event: (vim.vm.BackupEventInfo) {
dynamicType = <unset>,
eventType = "keepAlive",
code = 0,
message = "",
}
Installations of VMware Tools for virtual machines running on VMware ESX 3.5 Update 2 and later include the VMware Volume Shadow Copy Service (VSS). This service is required for effective quiescent snapshots in VMware vSphere or Infrastructure without relying on the VMware File Sync Driver.
However, third-party and partner VSS providers (if present in the guest operating system) conflict with the VMware Volume Shadow Service provider.
These additional VSS providers are commonly included with other backup products, such as Symantec System Recovery or BackupExec.
In most cases, these additional providers are not required if you are relying on VMware Consolidated Backup (VCB) or VMware Data Recovery (VDR) to perform virtual machine backups, and can be removed to resolve the issue.
If these providers are required in the guest operating system, however, remove the VMware VSS component from your VMware Tools installations in the affected guest systems. This forces VCB and VDR to use the "File Sync Driver" for quiescent snapshots, instead of VSS.
Note: A power cycle of the virtual machine is required to clear the Protocol error from VMX
error. If the virtual machine cannot be powered down due to tasks in progress, restart VMware Tools in the guest operating system and restart the management services on the ESX host hosting the virtual machine.
For more information, see Restarting the Management agents on an ESX or ESXi Server (1003490).
If you are using Symantec products in the affected guest operating system, see Compatibility of the Backup Exec Agent for VMware Virtual Infrastructure (AVVI) Symantec VSS Provider (BEVSSProvider) with the VMware VSS Provider for additional information and documents on this issue.
In Windows 2008 operating systems, the Volume Shadow Copy Service (VSS) is installed as part of the operating system and VMware Tools does not install VSS in Windows 2008.
To view a list of registered VSS providers for a Windows guest operating system, open a command prompt and run this command:
# vssadmin list providers
For more information on the vssadmin
command, see the Microsoft article, Vssadmin list providers.