vpxd crashes with Access Violation

Products

• VMware vCenter Server 6.0

Issue/Introduction

Symptoms:

• vpxd service crashes when following operations were performed :
  • Cross Storage vMotion
  • Deploying OVF template
  • Load balancing by Storage DRS
    
    
• In the vpxd.log file on vCenter Server, you see entries similar to:
  

  <YYYY-MM-DD>T<time> info vpxd[01234] [Originator@1234 sub=vpxLro opID=SelectResourcePageMediator-validate-518281-ngc:71200210-df-3d-12-74-55-6c] [VpxLRO] -- BEGIN task-126416 -- domain-c125 -- vim.ClusterComputeResource.placeVm -- 7217e2d2-1c31-c74b-ac72-144a3ad9d17d(156aedb4-b85d-be71-3258-1bd580cd284f)
  <YYYY-MM-DD>T<time> info vpxd[01234] [Originator@1234 sub=drmLogger opID=SelectResourcePageMediator-validate-518281-ngc:71200210-df-3d-12-74-55-6c] Drmdump written: C:\ProgramData\VMware\vCenterServer\logs\vmware-vpx\drmdump\fakepod/8712150089-sioMapVm.dump
  <YYYY-MM-DD>T<time> info vpxd[01234] [Originator@1234 sub=Default opID=SelectResourcePageMediator-validate-518281-ngc:71200210-df-3d-12-74-55-6c] CoreDump: Writing minidump
  <YYYY-MM-DD>T<time> panic vpxd[01234] [Originator@1234 sub=Default opID=SelectResourcePageMediator-validate-518281-ngc:71200210-df-3d-12-74-55-6c]                                                                       
  -->                                                                                                                                                                                                                                
  --> Panic: Win32 exception: Access Violation (0xc0000005)                                                                                                                                                                          
  -->    Read (0) at address 0000000000000000                                                                                                                                                                                        
  -->    rip: 00007ff6973b23a6 rsp: 00000046856edde0 rbp: 00000046856ede89                                                                                                                                                           
  -->    rax: 00000046a9db93b0 rbx: 00000046a08745f0 rcx: 0000000000000000                                                                                                                                                           
  -->    rdx: 00000046a9db93b0 rdi: 00000046a0874050 rsi: 000000469444b840                                                                                                                                                           
  -->    r8:  00000046a6b1fd30 r9:  000000008000170a r10: 0000004699170370                                                                                                                                                           
  -->    r11: 0000000000000000 r12: 0000004693741640 r13: 00000046a6b52ae0                                                                                                                                                           
  -->    r14: 0000000000001302 r15: 0000000000000000                                                                                                                                                                       
  -->                                                                                                                                                                                                                                
  --> Backtrace:                                                                                                                                                                                                                     
  --> [backtrace begin] product: VMware VirtualCenter, version: 6.5.0, build: build-<build>, tag: vpxd, cpu: x86_64, os: <OS info>, buildType: release                                                                                 
  --> backtrace[00] vmacore.dll[0x001F2D4A]                                                                                                                                                                                          
  --> backtrace[01] vmacore.dll[0x000685C0]                                                                                                                                                                                          
  --> backtrace[02] vmacore.dll[0x0006AA8E]                                                                                                                                                                                          
  --> backtrace[03] vmacore.dll[0x00224E77]                                                                                                                                                                                          
  --> backtrace[04] vmacore.dll[0x00224F6B]                                                                                                                                                                                          
  --> backtrace[05] vmacore.dll[0x0022DA0E]                                                                                                                                                                                          
  --> backtrace[06] MSVCR120.dll[0x0005F2E5]                                                                                                                                                                                         
  --> backtrace[07] MSVCR120.dll[0x0005DBC7]                                                                                                                                                                                         
  --> backtrace[08] MSVCR120.dll[0x0005DADC]                                                                                                                                                                                         
  --> backtrace[09] MSVCR120.dll[0x0005ED64]                                                                                                                                                                                         
  --> backtrace[10] MSVCR120.dll[0x0005F5D7]                                                                                                                                                                                         
  --> backtrace[11] vpxd.exe[0x01181626]                                                                                                                                                                                             
  --> backtrace[12] ntdll.dll[0x0009341D]                                                                                                                                                                                            
  --> backtrace[13] ntdll.dll[0x00054857]                                                                                                                                                                                            
  --> backtrace[14] ntdll.dll[0x000925AA]                                                                                                                                                                                            
  --> backtrace[15] vpxd.exe[0x00E423A6]                                                                                                                                                                                             
  --> backtrace[16] vpxd.exe[0x00F22253]                                                                                                                                                                                             
  --> backtrace[17] vpxd.exe[0x00F13945]                                                                                                                                                                                             
  --> backtrace[18] vpxd.exe[0x00F231C9]                                                                                                                                                                                             
  --> backtrace[19] vpxd.exe[0x00E0C719]                                                                                                                                                                                             
  --> backtrace[20] vpxd.exe[0x00DCF00A]                                                                                                                                                                                             
  --> backtrace[21] vpxd.exe[0x008A7FDE]                                                                                                                                                                                     
  --> backtrace[22] vim-types.dll[0x0004A5B0]                                                                                                       
  --> backtrace[23] vmomi.dll[0x0004D917]                                                                                                                                                                                            
  --> backtrace[24] vpxd.exe[0x000CF516]                                                                                                                                                                                             
  --> backtrace[25] vpxd.exe[0x000BA95F]                                                                                                                                                                                             
  --> backtrace[26] vpxd.exe[0x000BDFC1]                                                                                                                                                                                             
  --> backtrace[27] vpxd.exe[0x000BA4AD]                                                                                                                                                                                             
  --> backtrace[28] vpxd.exe[0x000BCC86]                                                                                                                                                                                             
  --> backtrace[29] vmacore.dll[0x001868AB]                                                                                                                                                                                          
  --> backtrace[30] vmacore.dll[0x0018789C]                                                                                                                                                                                          
  --> backtrace[31] vmacore.dll[0x00220B89]                                                                                                                                                                                          
  --> backtrace[32] MSVCR120.dll[0x00024F7F]                                                                                                                                                                                         
  --> backtrace[33] MSVCR120.dll[0x00025126]                                                                                                                                                                                         
  --> backtrace[34] KERNEL32.DLL[0x000013D2]                                                                                                                                                                                         
  --> backtrace[35] ntdll.dll[0x000154F4]                                                                                                                                                                                            
  --> [backtrace end]                                                                                                                                                                             

Environment

vCenter Server 6.5

Cause

This issue occurs because vCenter Server cannot handle following case:

• VM has multiple disks that reside on different datastores that belong to different storage clusters.
• VM has multiple disks that reside on different datastores that belongs to storage profile.

Resolution

This issue is resolved in VMware vSphere 6.5 U2, available at VMware Downloads.

Workaround:
Place the disks on the same datastore and restart the vpxd service