vVOL Cannot Create File - 'mkdir: can't create directory 'xxx': Input/output error'

Products

• VMware vSphere ESXi

Issue/Introduction

Unable to create a VM or create a directory on a vVOL datastore:

via SSH session to an ESXi host:

'mkdir: can't create directory 'xxx': Input/output error'

via ESXi UI:

Environment

VMware ESXi 8.0 +

Cause

A volume group limit has been reached on the storage array end, restricting the creation of any new files on the for the vitural volume (vVOL).

Within the /var/log/vmware directory, the vmkernel.log file will report the following output error for the creation of the directory:

2025-05-09T14:55:00.607Z In(182) vmkernel: cpu3:28994187)osfs: DebugDumpVmklinkResponse:813: {ID: 70e4; type:MKDIR; pid:[    vvol]; cid:xxxx-xxxx; aid:xxxx-xxxx; status:I/O error; bufLen:0;

2025-05-09T14:55:00.607Z In(182) vmkernel: cpu3:28994187)osfs: OSFS_VmklinkMkdir:590: Mkdir failure from osfsd (pid: [    vvol], cid: xxxx-xxxx, friendlyName: teste)

2025-05-09T14:55:00.607Z In(182) vmkernel: cpu3:28994187)osfs: OSFS_CreateFile:202: Failed mkdir pid:[    vvol], cid:xxxx-70aaxxxx9f8f8431b05c, child:teste

When looking at the same time stamp in the vvold.log, the volume group limit error message is outputted:

2025-05-09T14:55:00.606Z Er(163) VVold[2099917] [Originator@6876 sub=Default IpcCtx=2100158-2] VasaOp::IsSuccessful [#605627]: createVirtualVolume transient failure: 16 (OUT_OF_RESOURCE / 400: volume group limit reached. / )

2025-05-09T14:55:00.606Z Er(163) VVold[2099917] [Originator@6876 sub=Default IpcCtx=2100158-2] VasaOp[#605627] ===> FINAL FAILURE createVirtualVolume, error (OUT_OF_RESOURCE / 400: volume group limit reached. / ) VP (ftz02str02-ct1) Container (xxxx-xxx-xxx-xxx-xxxx) timeElapsed=74 msecs (#outstanding 0)

Resolution

Reach out to the vVOL storage provider to review the storage array configuration and ensure the volume group limit is not being reached.

Additional Information

Each storage array has a limit of the number of volume groups that can be created. The limit is determined by the specific array model.

Below is an article from Pure Storage stating the volume group limit based on the array model:

https://support.purestorage.com/bundle/m_release_notes_for_vmware_solutions/page/Solutions/VMware_Platform_Guide/Release_Notes_for_VMware_Solutions/topics/task/t_improvements.html