HA Event and resource utilization

Products

• VMware vSphere ESXi

Issue/Introduction

This kb helps in understanding some the following during an HA event:

• Number of VMs impacted 
• Current consumption of CPU/Memory Resources on each ESXi host
• VMs registration with ESXi hosts

Environment

7.x
8.x

Resolution

All the HA events will be reported in the Master Node of the cluster. In order to find the master node you can ssh into any ESXi host from the cluster and search for "master" in /var/run/log/fdm.log file. You will see this in the logs:

Fdm[#######]: [Originator@1234 sub=Cluster opID=clusterManager.cpp:###-########] hostId=host-123456 state=Slave master=host-654321 isolated=false host-list-version=54 config-version=72 vm-metadata-version=140

In the above snippet the master host is host-654321. You can check the following by doing an ssh session to the master node and looking at the the /var/run/log/fdm.log:

• Number of VMs impacted: 
  
  

  Fdm[#######]: [Originator@1234 sub=Invt opID=WorkQueue-#######] Get 10 VMs on host host-###### in 1 state

  
  
  
• Current consumption of CPU/Memory Resources on each ESXi host:
  
  

  Fdm[########]: --> Hosts (4):
  Fdm[########]: -->     host-######1 state=Live reservedMem=2200000000 reservedCpu=0 unreservedMem=1060000000000 unreservedCpu=169000 inMaintenanceMode=false
  Fdm[########]: -->             cpuLoadMHz=31212 memLoadMB=327653 cpuFrequencyHz=2799999720 numCpuCores=64 totalMemoryBytes=1099257196544
  Fdm[########]: -->             proxySwitch: key DvsPortset-0 uuid ## ## ## ## ## ## ## ## ## ## ## ## ## ## ## ## ports ####
  Fdm[########]: -->                     proxySwitchPnics DvsPortset-0 -> vmnic# vmnic#
  Fdm[########]: -->             pnic vmnic# availBandwidth 0 numVnicsUsing 0
  Fdm[########]: -->             pnic vmnic# availBandwidth 0 numVnicsUsing 0
  Fdm[########]: -->     host-######2 state=Live reservedMem=2200000000 reservedCpu=0 unreservedMem=1060000000000 unreservedCpu=169000 inMaintenanceMode=false
  Fdm[########]: -->             cpuLoadMHz=36929 memLoadMB=351738 cpuFrequencyHz=2799999720 numCpuCores=64 totalMemoryBytes=1099257196544
  Fdm[########]: -->             proxySwitch: key DvsPortset-0 uuid ## ## ## ## ## ## ## ## ## ## ## ## ## ## ## ## ports ####
  Fdm[########]: -->                     proxySwitchPnics DvsPortset-0 -> vmnic# vmnic#
  Fdm[########]: -->             pnic vmnic# availBandwidth 0 numVnicsUsing 0
  Fdm[########]: -->             pnic vmnic# availBandwidth 0 numVnicsUsing 0
  Fdm[########]: -->     __localhost__ state=Live reservedMem=2200000000 reservedCpu=0 unreservedMem=1060000000000 unreservedCpu=169000 inMaintenanceMode=false
  Fdm[########]: -->             cpuLoadMHz=31512 memLoadMB=365294 cpuFrequencyHz=2799999720 numCpuCores=64 totalMemoryBytes=1099257196544
  Fdm[########]: -->             proxySwitch: key DvsPortset-0 uuid ## ## ## ## ## ## ## ## ## ## ## ## ## ## ## ## ports ####
  Fdm[########]: -->                     proxySwitchPnics DvsPortset-0 -> vmnic# vmnic#
  Fdm[########]: -->             pnic vmnic# availBandwidth 0 numVnicsUsing 0
  Fdm[########]: -->             pnic vmnic# availBandwidth 0 numVnicsUsing 0
  Fdm[########]: -->     host-######4 state=Dead reservedMem=2200000000 reservedCpu=0 unreservedMem=1060000000000 unreservedCpu=169000 inMaintenanceMode=false
  Fdm[########]: -->             cpuLoadMHz=38123 memLoadMB=400183 cpuFrequencyHz=2799999720 numCpuCores=64 totalMemoryBytes=1099257196544
  Fdm[########]: -->             proxySwitch: key DvsPortset-0 uuid ## ## ## ## ## ## ## ## ## ## ## ## ## ## ## ## ports ####
  Fdm[########]: -->                     proxySwitchPnics DvsPortset-0 -> vmnic# vmnic#
  Fdm[########]: -->             pnic vmnic# availBandwidth 0 numVnicsUsing 0
  Fdm[########]: -->             pnic vmnic# availBandwidth 0 numVnicsUsing 0

• VMs registration with ESXi hosts:
  
  

  Fdm[########]: -->     EventEx=com.vmware.vc.ha.VmRestartedByHAEvent vm=/vmfs/volumes/<Datastore-Name>/<VM-Directory>/<VM-Name>.vmx host=<Host-Name> tag=<Host-Name>
  Fdm[########]: -->     EventEx=com.vmware.vc.ha.VmRestartedByHAEvent vm=/vmfs/volumes/<Datastore-Name>/<VM-Directory>/<VM-Name>.vmx host=<Host-Name> tag=<Host-Name>
  Fdm[########]: -->     EventEx=com.vmware.vc.ha.VmRestartedByHAEvent vm=/vmfs/volumes/<Datastore-Name>/<VM-Directory>/<VM-Name>.vmx host=<Host-Name> tag=<Host-Name>
  Fdm[########]: -->     EventEx=com.vmware.vc.ha.VmRestartedByHAEvent vm=/vmfs/volumes/<Datastore-Name>/<VM-Directory>/<VM-Name>.vmx host=<Host-Name> tag=<Host-Name>