Suspending a virtual machine on ESX/ESXi to collect diagnostic information
search cancel

Suspending a virtual machine on ESX/ESXi to collect diagnostic information

book

Article ID: 326327

calendar_today

Updated On:

Products

VMware vSphere ESXi

Issue/Introduction

When troubleshooting issues related to virtual machine availability or responsiveness on VMware ESXi, it may be necessary to suspend a virtual machine and collect diagnostic information.

For vSphere 6.5 onward, support bundles can include encrypted information from an ESXi host. For more information on what information is included in the support bundles, see Data collected when gathering diagnostic information from vSphere products (2147388)

This article provides several methods for suspending a virtual machine on several versions of VMware ESXi. Deciding whether to crash or suspend a virtual machine is outside the scope of this article.
 

For more information on:



Environment

VMware ESXi 3.5.x Installable
VMware vSphere ESXi 8.0.x
VMware ESX Server 3.0.x
VMware ESXi 4.1.x Installable
VMware ESXi 3.5.x Embedded
VMware vSphere ESXi 6.0
VMware ESXi 4.1.x Embedded
VMware ESX 4.0.x
VMware vSphere ESXi 6.7
VMware vSphere ESXi 5.0
VMware ESX 4.1.x
VMware ESX Server 3.5.x
VMware ESXi 4.0.x Embedded
VMware vSphere ESXi 6.5
VMware ESXi 4.0.x Installable
VMware vSphere ESXi 5.1
VMware vSphere ESXi 7.0.0
VMware vSphere ESXi 5.5

Resolution

Several methods are available to suspend a virtual machine, some of which are applicable to specific versions of VMware ESXi. Choose the method most appropriate to your environment:

 

ESXi 6.0 - 7.0.x VMs on standard SAN, via vSphere Client

Prerequisites

  • vSphere Client connected to the host or vCenter Server.

  • The hostd management service must be running.

  • The virtual machine must be registered in the inventory.

The vSphere Client can be used to suspend a virtual machine, and its datastore browser used to download the suspend state file.

  1. Use the vSphere Client to connect to an ESXi host or vCenter Server as an administrative user.

  2. Select a virtual machine in the inventory.

  3. Open the console tab, and take a screenshot.

  4. Right-click the virtual machine, and select Power - Suspend.

  5. Wait for the Suspend virtual machine task to complete.

  6. Browse the datastore where the virtual machine configuration files are stored.

  7. collect the suspend state files

    1. If the virtual machine is hardware version 10 or lower: 

      • Locate the .vmss file in the directory of the virtual machine.

      • Right-click the .vmss file, and download it to the client.

    2. if the virtual machine is hardware version 11 or newer, or if the virtual machine is running on a virtual volume (VVOL):

      • Locate the .vmss file and the .vmem file in the directory of the virtual machine.

      • Right-click each of the 2 files, and download them to the client.


Note: For VMware vSphere 8.0 refer to VMware Document
 

ESXi 6.0 - 7.0.x VMs on standard SAN, via vm-support command-line

Prerequisites

  • Console session open to the ESXi host, either at the local console or via SSH.

  • The virtual machine must be registered in the inventory.

The vm-support command-line log collection utility supports the use of manifests to create or collect specific information from a host or virtual machine. For more information, see Collecting diagnostic information for VMware ESX/ESXi using the vm-support command (1010705):

  1. Log in to the ESXi Shell as root.

  2. Obtain a list of all registered and running virtual machines using this command:

    # vim-cmd vmsvc/getallvms

  3. Identify the affected VM and not down its ID

  4. Suspend the Virtual Machine through CLI using the ID from step 3

    # vim-cmd vmsvc/power.suspend VMID

Note: If the incorrect VMID is selected in the above command, it may lead to aproduction outage. Please ensure to select the correct VMID to suspend the correct VM.

  1. Collect suspend state from a specific virtual machine, plus performance metrics and logs from the host, using this command:

    # vm-support --performance --manifests="HungVM:Suspend_VM" --groups="Hardware Logs Network Storage System Userworld VirtualMachines" --vm="</vmfs/volumes/path/to/virtualmachine.vmx>"

  2. A vm-support log bundle is created locally on the host, its filename and location are displayed when complete. Copy this file off the host manually.

 

ESXi 6.0 - 7.0.x VMs on vSAN, via vSphere Client

  1. Browse the datastore, select the .vmem file.

  2. Drag and drop the .vmem file from the vSAN datastore to a local datastore with sufficient free space.

  3. Download the file from the local datastore using the WebClient GUI or WinSCP.

 

ESXi 6.0 - 7.0.x VMs on vSAN, via Command-Line

  1. Suspend the VM following the steps mentioned in this. KB.

  2. Log on to the ESXi host using Putty, where the VM in question is registered and running.

  3. Navigate to the VM directory location, e.g.

    # cd /vmfs/volumes/vsan:524fcc9a876dcefd-be39dfd52bd37e0e/<VM directory>

  4. Run the command "cat" against the .vmem file:

    # cat <file name>.vmem

  5. Retrieve the Object ID information from the output.

  6. Run the command:

    # /usr/lib/vmware/osfs/bin/objtool open -u <object ID>

  7. Use WinSCP to log on to the ESXi host and browse to the file path "/vmfs/devices/vsan/<object ID>" to move the file to the local or remote location.

  8. Rename the file extension to .vmem for debugging purposes.

 



Additional Information

If the virtual machine is a Full Clone desktop in Horizon, it must be placed on Maintenance Mode before proceeding with the preceding steps. Otherwise, if Horizon has the desktops set to Ensure desktops are always powered on, the virtual machine gets powered on as the virtual machine is suspended.

  1. In the VMware Horizon View Administrator, Navigate to Inventory > Desktops.

  2. Right-click the virtual machine and click Enter Maintenance Mode.

  3. Suspend the virtual machine.


If the virtual machine is an Instant Clone desktop in Horizon, you won't be able suspend the virtual machine in vSphere as Horizon will recycle the VM before you can complete your data collection.  Instead follow these steps:

  1. Take a snapshot of the VM in vSphere.  Select the option to Snapshot the virtual machine's memory.  

  2. Follow the steps in https://kb.vmware.com/s/article/2003941 to convert the vmss to a dmp file. 


“vm-support” command in ESX/ESXi to collect diagnostic information
vShield Endpoint / NSX Guest Introspection のトラブルシューティング
Collecting diagnostic information for VMware ESX/ESXi

Powered by Wolken Software