PSOD on ESXi host due to rare race condition.

Products

• VMware vSAN

Issue/Introduction

#PF Exception 14 in world 2107967:vsanmgmtd-wo IP 0x4200163735a7 addr 0x34
        PTEs:0x0;
        2025-08-04T00:04:29.550Z cpu47:2107967 opID=b1c117f0)cr0=0x80010031 cr2=0x34 cr3=0xcb491a1000 cr4=0x146768
        2025-08-04T00:04:29.556Z cpu47:2107967 opID=b1c117f0)FMS=06/55/4 uCode=0x2007108
        2025-08-04T00:04:29.570Z cpu47:2107967 opID=b1c117f0)frame=0x453a49c9b420 ip=0x4200163735a7 err=0x0 rflags=0x10202
        2025-08-04T00:04:29.575Z cpu47:2107967 opID=b1c117f0)rax=0x0 rbx=0x0 rcx=0x0
        2025-08-04T00:04:29.582Z cpu47:2107967 opID=b1c117f0)rdx=0x0 rbp=0x0 rsi=0x1540400000
        2025-08-04T00:04:29.593Z cpu47:2107967 opID=b1c117f0)rdi=0x4326e8f01258 r8=0x4326e8c01220 r9=0x23020
        2025-08-04T00:04:29.603Z cpu47:2107967 opID=b1c117f0)r10=0x28 r11=0x4326ede1d040 r12=0x453a49c9b53c
        2025-08-04T00:04:29.613Z cpu47:2107967 opID=b1c117f0)r13=0x0 r14=0x453a49c9b538 r15=0x4326e8c01220
        *PCPU47:2107967/vsanmgmtd-worke
        PCPU  0: SSVSVVVVVSUVVSSSSSVVSSUSSVUVSSSVVVSSUSVVSSVVSVVUVSVSSUVVSVVUVUVU
        PCPU 64: VVUSSVVVVVSSUVVVVSVSSUVVVUVUSSVV
        2025-08-04T00:04:29.657Z cpu47:2107967 opID=b1c117f0)Code start: 0x420014400000 VMK uptime: 269:17:25:35.796
        2025-08-04T00:04:29.679Z cpu47:2107967 opID=b1c117f0)0x453a49c9b4e0:[0x4200163735a7][email protected]#0.0.0.1+0x17 stack: 0x0
        2025-08-04T00:04:29.703Z cpu47:2107967 opID=b1c117f0)0x453a49c9b4e8:[0x42001637421a][email protected]#0.0.0.1+0xf stack: 0x4326e8c01220
        2025-08-04T00:04:29.726Z cpu47:2107967 opID=b1c117f0)0x453a49c9b4f0:[0x420016392de6][email protected]#0.0.0.1+0x6f stack: 0x0
        2025-08-04T00:04:29.751Z cpu47:2107967 opID=b1c117f0)0x453a49c9b530:[0x420016392f0d][email protected]#0.0.0.1+0x22 stack: 0x453a49c9b728
        2025-08-04T00:04:29.775Z cpu47:2107967 opID=b1c117f0)0x453a49c9b570:[0x420016370cb0][email protected]#0.0.0.1+0x1f5 stack: 0x4502ca44fbe8
        2025-08-04T00:04:29.800Z cpu47:2107967 opID=b1c117f0)0x453a49c9b590:[0x4200163d9227][email protected]#0.0.0.1+0x80 stack: 0xea82524b31335852
        2025-08-04T00:04:29.819Z cpu47:2107967 opID=b1c117f0)0x453a49c9b5e0:[0x420014401e4a]VSI_GetInfo@vmkernel#nover+0x127 stack: 0x41ffdd000072
        2025-08-04T00:04:29.841Z cpu47:2107967 opID=b1c117f0)0x453a49c9b650:[0x42001492c56b]UW64VMKSyscallUnpackVSI_Get@vmkernel#nover+0x114 stack: 0x93e592c4e4
        2025-08-04T00:04:29.861Z cpu47:2107967 opID=b1c117f0)0x453a49c9bee0:[0x4200148b542e]User_UWVMK64SyscallHandler@vmkernel#nover+0x183 stack: 0x0
        2025-08-04T00:04:29.877Z cpu47:2107967 opID=b1c117f0)0x453a49c9bf40:[0x42001454b638]SyscallUWVMK64@vmkernel#nover+0x90 stack: 0x0
        2025-08-04T00:04:29.894Z cpu47:2107967 opID=b1c117f0)base fs=0x0 gs=0x42004bc00000 Kgs=0x0
        2025-03-15T01:11:59.471Z cpu8:80725129)vmsyslog logger vxr-vcf-loginsight.cssd.pitt.edu:514 lost 804 log messages
        2025-03-14T13:11:59.445Z cpu84:80725129)vmsyslog logger vxr-vcf-loginsight.cssd.pitt.edu:514 lost 1 log messages
        2025-03-07T23:51:24.497Z cpu84:76241196)vmsyslog logger vxr-vcf-loginsight.cssd.pitt.edu:514 lost 2041 log messages
        2025-03-07T11:51:24.139Z cpu46:76241196)vmsyslog logger vxr-vcf-loginsight.cssd.pitt.edu:514 lost 1 log messages
        2025-03-03T17:55:39.728Z cpu50:73546143)vmsyslog logger vxr-vcf-loginsight.cssd.pitt.edu:514 lost 2078 log messages
        2025-03-03T05:55:39.705Z cpu54:73546143)vmsyslog logger vxr-vcf-loginsight.cssd.pitt.edu:514 lost 1 log messages
        2025-02-05T17:10:49.918Z cpu82:57198252)vmsyslog logger vxr-vcf-loginsight.cssd.pitt.edu:514 lost 1114 log messages
        2025-02-05T05:10:49.823Z cpu39:57198252)vmsyslog logger vxr-vcf-loginsight.cssd.pitt.edu:514 lost 1 log messages
        2025-01-06T02:58:44.016Z cpu29:38745153)vmsyslog logger vxr-vcf-loginsight.cssd.pitt.edu:514 lost 1 log messages
        2024-11-07T06:25:27.849Z cpu59:2097818)vmsyslog logger vxr-vcf-loginsight.cssd.pitt.edu:514 lost 1 log messages

        2025-08-04T08:28:37.552Z localcli[2301491]: mark: performance log bundle collection for snapshot 0 started
        2025-08-04T08:30:10.866Z localcli[2302196]: mark: performance log bundle collection for snapshot 0 ended
        2025-08-04T08:30:11.057Z localcli[2302201]: mark: performance log bundle collection for snapshot 1 started
        2025-08-04T08:31:44.975Z localcli[2302858]: mark: performance log bundle collection for snapshot 1 ended
        2025-08-04T08:31:45.164Z localcli[2302860]: mark: performance log bundle collection for snapshot 2 started
        2025-08-04T08:33:18.672Z localcli[2303791]: mark: performance log bundle collection for snapshot 2 ended
        2025-08-04T08:33:18.858Z localcli[2303794]: mark: performance log bundle collection for snapshot 3 started
        2025-08-04T08:34:52.427Z localcli[2304517]: mark: performance log bundle collection for snapshot 3 ended

Environment

ESXi 7.0.X builds

Cause

Issue occurs due to a rare race condition where vdisk delete(resync and delete vm) and VSI_GetInfo for virsto(virstoStats) occur at the same time.

Resolution

Issue is extremely rare and not likely to occur again

Issue is resolved in ESXi 8.X builds