"VASpace (08/13) DiskDump: Partial Dump: Out of space o=0x63ff800 l=0x1000" error in ESXi host
search cancel

"VASpace (08/13) DiskDump: Partial Dump: Out of space o=0x63ff800 l=0x1000" error in ESXi host

book

Article ID: 321310

calendar_today

Updated On:

Products

VMware vSphere ESXi

Issue/Introduction

Symptoms:
When the dump file generated by PSOD is larger than the file which previously set to the diagnostic partition or slot size, you experience these symptoms:
  • ESXi host generates Partial Dump.
  • You see the PSOD:
VASpace (08/13) DiskDump: Partial Dump: Out of space o=0x63ff800 l=0x1000
 
  • In the /var/log/vobd.log file, you see log entries similar to: 
YYYY-MM-DDTHH:MM:SS.XXXZ: [GenericCorrelator] 42315340us: [vob.user.coredump.capacity.insufficient] The storage capacity of the coredump targets is insufficient to capture a complete coredump. Recommended coredump capacity is 299 MiB.


Environment

VMware vSphere ESXi 6.5
VMware vSphere ESXi 6.7
VMware vSphere ESXi 6.0

Cause

This issue occurs when the generated dump size is larger than the size which was previously set to the diagnostic partition or slot size. By default, the diagnostic partition is 2.5GB.

Note: The dump size varies depending on the environment and operation. Compared to non-vSAN environment, in vSAN environments dump files tend to larger. Therefore, in the large scale environment, highly loaded environment, and vSAN environment, you must change the slot size and the partition size.

Resolution

To resolve this issue:

 

Notes:
  • The size should be larger than [Recommended coredump capacity] described in /var/log/vobd.log file.
  • When the size is not described in /var/log/vobd.log file, VMware recommends to set the slot size to more than 300MB.
  • Diagnostic partition is set as 2.5GB by default.
  • When you set the slot size to more than 2.5 GB, you must set the dump partition in advance.

To check the diagnostic partition:

  1.   Check the current diagnostic partition by running the esxcli command using ESX shell or SSH. For more information to use ESX shell or SSH, see Using ESXi Shell in ESXi.
For example:
# esxcli system coredump partition list

Name                   Path                                       Active  Configured
---------------------  -----------------------------------------  ------  ----------
mpx.vmhba1:C0:T0:L0:7  /vmfs/devices/disks/mpx.vmhba1:C0:T0:L0:7   false       false
mpx.vmhba1:C0:T0:L0:9  /vmfs/devices/disks/mpx.vmhba1:C0:T0:L0:9    true        true

If the [Active] field is true (the ninth partition of mpx.vmhba1:C0:T0:L0:9), the partition is set as the diagnostic partition. For more information, see Configuring a diagnostic coredump partition on an ESXi host.
  1. Check the diagnostic partition size with partedUtil command. Specify the disk that includes the diagnostic partition, and check the line where the first field is partition number of the diagnostic partition.
For example:

# partedUtil getptbl "/vmfs/devices/disks/mpx.vmhba1:C0:T0:L0"
gpt
1305 255 63 20971520
1 64 8191 C12A7328F81F11D2BA4B00A0C93EC93B systemPartition 128
5 8224 520191 EBD0A0A2B9E5443387C068B6B72699C7 linuxNative 0
6 520224 1032191 EBD0A0A2B9E5443387C068B6B72699C7 linuxNative 0
7 1032224 1257471 9D27538040AD11DBBF97000C2911D1B8 vmkDiagnostic 0
8 1257504 1843199 EBD0A0A2B9E5443387C068B6B72699C7 linuxNative 0
9 1843200 7086079 9D27538040AD11DBBF97000C2911D1B8 vmkDiagnostic 0
2 7086080 15472639 EBD0A0A2B9E5443387C068B6B72699C7 linuxNative 0
3 15472640 20971486 AA31E02A400F11DB9590000C2911D1B8 vmfs 0
  1. Check the sector number from the second (starting sector) and third (ending sector) field.
Multiply the number by 512, and convert it to a byte unit.

For example:
(7086080 - 1843200) * 512 = 2684354560 [Bytes]


To expand the diagnostic partition:

To check the slot size:

  1. Using the Web Client, select the ESXi host.
  2. Click the Configure tab.
  3. Select the Advanced System Settings.
  4. Enter SlotSize into the [Filter] option on the right side, and search the correct parameter.
  5. Select the [VMkernel.Boot.diskDumpSlotSize] option (the unit is MB).

To expand the slot size:

  1. Using the Web Client, select the ESXi host.
  2. Click the Configure tab.
  3. Select the Advanced System Settings.
  4. Enter SlotSize into the Filter option on the right side, and search the correct parameter.
  5. The VMkernel.Boot.diskDumpSlotSize option is displayed on the list.
  6. On the right pane of the Advanced System Settings page, select the option, and click Edit
  7. Change the slot size to the desired value and click OK.



Additional Information