VM HA failed with fault type "ConcurrentAccess"
search cancel

VM HA failed with fault type "ConcurrentAccess"

book

Article ID: 417696

calendar_today

Updated On:

Products

VMware vCenter Server

Issue/Introduction

  • Do vMotion of a VM from one ESXi host to another. Before vmotion finished, source host lost power and powered off.
  • HA failed for this VM with error: fdm.placementFault.vim.fault.ConcurrentAccess.label.
  • On HA master ESXi host, fdm.log has following records:

[Originator@xxxx sub=FDM opID=WorkQueue-xxxx] New event: EventEx=com.vmware.vc.HA.ClusterFailoverActionInitiatedEvent vm= host= tag=host-xx:xxxx:5
[Originator@xxxx sub=Placement opID=placementService.cpp ] 1 Vms are to be powered on
[Originator@xxxx sub=Invt opID=placementService.cpp] Compat list for /vmfs/volumes/vsan:xxxxxxxxxxxxxx-xxxxxxxxxxxxx/xxxxxxx-xxxx-xxxx-xxxx-xxxxxxx/vm_name.vmx: __localhost__, host-xx, host-xx, host-xx
[Originator@xxxx sub=Placement opID=placementService.cpp] Placement request sent to VC, starting failover thread
[Originator@xxxx sub=Placement opID=xxxx] No recommendation is generated
[Originator@xxxx sub=Placement opID=xxxx] Vm /vmfs/volumes/vsan:xxxxxxxxxxxxxx-xxxxxxxxxxxxx/xxxxxxx-xxxx-xxxx-xxxx-xxxxxxx/vm_name.vmx failed placement with fault [N3Vim5Fault16ConcurrentAccessE:0x000000f54e80e1f0]
[Originator@xxxx sub=Placement opID=xxxx] Setting insufficient resource timeout to 60 seconds and retrying placement for vm /vmfs/volumes/vsan:xxxxxxxxxxxxxx-xxxxxxxxxxxxx/xxxxxxx-xxxx-xxxx-xxxx-xxxxxxx/vm_name.vmx
[Originator@xxxx sub=Placement opID=xxxx] Reset the placement status of vm /vmfs/volumes/vsan:xxxxxxxxxxxxxx-xxxxxxxxxxxxx/xxxxxxx-xxxx-xxxx-xxxx-xxxxxxx/vm_name.vmx to 0, vim.fault.ConcurrentAccess (vim.fault.ConcurrentAccess)
[Originator@xxxx sub=FDM opID=WorkQueue-xxxx] New event: Event=vim.event.NotEnoughResourcesToStartVmEvent vm=/vmfs/volumes/vsan:xxxxxxxxxxxxxx-xxxxxxxxxxxxx/xxxxxxx-xxxx-xxxx-xxxx-xxxxxxx/vm_name.vmx host=host-xx tag=host-xx:xxxx:6

  • vCenter vpxd.log recorded that DRS failed to place a host with fault type "ConcurrentAccess" and fault Message "com.vmware.cdrs.placeVm.concurrentAccess":

info vpxd[xxxx] [Originator@xxxx sub=DAS opID=FdmWaitForUpdates-vim.ClusterComputeResource:domain-cxxxx] Invoke DRS for VMs placement recommendation in multiple passes; maxPass: 1, VM: [vim.VirtualMachine:vm-xx,vm_name], type: VmFailover
info vpxd[xxxx] [Originator@xxxx sub=DAS opID=FdmWaitForUpdates-vim.ClusterComputeResource:domain-cxxxx] Invoking DRS for VM Placement recommendation; VM: [vim.VirtualMachine:vm-xx,vm_name], type: VmFailover, haVmVmRuleBehavior: 0
info vpxd[xxxx] [Originator@xxxx sub=cdrsPlmt opID=FdmWaitForUpdates-vim.ClusterComputeResource:domain-cxxxx] Dump section 1268665646 created for cluster [vim.ClusterComputeResource:domain-cx,cluster_name]
info vpxd[xxxx] [Originator@xxxx sub=cdrsPlmt opID=FdmWaitForUpdates-vim.ClusterComputeResource:domain-cxxxx] Vm [vim.VirtualMachine:vm-xx,vm_name] failed constraint check false on host [vim.HostSystem:host-xx,esxi_fqdn] with <obj xmlns:xsd="http://www.w3.org/2001/XMLSchema" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns="urn:vim25" versionId="8.0.3.0" xsi:type="LocalizedMethodFault"><fault xsi:type="ConcurrentAccess"><faultMessage><key>com.vmware.cdrs.placeVm.concurrentAccess</key><arg><key>threadID</key><value xsi:type="xsd:long">7335</value></arg></faultMessage></fault><localizedMessage></localizedMessage></obj>
info vpxd[xxxx] [Originator@xxxx sub=cdrsPlmt opID=FdmWaitForUpdates-vim.ClusterComputeResource:domain-cxxxx] Vm [vim.VirtualMachine:vm-xx,vm_name] failed constraint check false on host [vim.HostSystem:host-xx,esxi_fqdn] with <obj xmlns:xsd="http://www.w3.org/2001/XMLSchema" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns="urn:vim25" versionId="8.0.3.0" xsi:type="LocalizedMethodFault"><fault xsi:type="ConcurrentAccess"><faultMessage><key>com.vmware.cdrs.placeVm.concurrentAccess</key><arg><key>threadID</key><value xsi:type="xsd:long">7335</value></arg></faultMessage></fault><localizedMessage></localizedMessage></obj>
info vpxd[xxxx] [Originator@xxxx sub=cdrsPlmt opID=FdmWaitForUpdates-vim.ClusterComputeResource:domain-cxxxx] Vm [vim.VirtualMachine:vm-xx,vm_name] failed constraint check false on host [vim.HostSystem:host-xx,esxi_fqdn] with <obj xmlns:xsd="http://www.w3.org/2001/XMLSchema" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns="urn:vim25" versionId="8.0.3.0" xsi:type="LocalizedMethodFault"><fault xsi:type="ConcurrentAccess"><faultMessage><key>com.vmware.cdrs.placeVm.concurrentAccess</key><arg><key>threadID</key><value xsi:type="xsd:long">7335</value></arg></faultMessage></fault><localizedMessage></localizedMessage></obj>
info vpxd[xxxx] [Originator@xxxx sub=DAS opID=FdmWaitForUpdates-vim.ClusterComputeResource:domain-cxxxx] Last Pass - No DRS Recommendation generated. Process not placed info; VM: [vim.VirtualMachine:vm-xx,vm_name]

  • As vMotion source host met power outage in the process of vMotion, the vMotion task still exists on vCenter. The vMotion task failed around one hour later.

info vpxd[xxxx] [Originator@xxx sub=vpxLro opID=xxxxxx] [VpxLRO] -- BEGIN task-xxxx -- vm-xx -- vim.VirtualMachine.relocate --xxxxxxxxxxxxxx-xxxxxxxxxxxxx(xxxxxxx-xxxx-xxxx-xxxx-xxxxxxx)
error vpxd[xxxx] [Originator@xxx sub=Default opID=xxxxxx] [VpxLRO] -- ERROR task-xxxx --xxxxxxxxxxxxxx-xxxxxxxxxxxxx(xxxxxxx-xxxx-xxxx-xxxx-xxxxxxx) -- vm-xx -- vim.VirtualMachine.relocate: :vmodl.fault.HostCommunication

Environment

VMware VCenter Server

Cause

As DRS is enabled, when fdm power on a vm, it will send the host placement request to vCenter DRS.

As vMotion task has not finished, DRS failed to place a host with fault type "ConcurrentAccess" and fault Message "com.vmware.cdrs.placeVm.concurrentAccess".

This caused HA failover vm failure.

Resolution

Power on vMotion source ESXi host.

Powered by Wolken Software