vMotion to 6.7 host that has too many VMs is extremely slow and usually fails at 18%

Products

• VMware vSphere ESXi

Issue/Introduction

Symptoms:
1- vmotion to 6.7 host that has too many VMs is extremely slow and usually fails at 18%

2- hostd.log shows vmotion failed with the below error message :
"Timed out waiting for migration start request"

3- property collector slowness is seen as below :

hostd.0: 2021-02-18T08:58:05.208Z warning hostd[2100962] [Originator@6876 sub=PropertyCollector opID=df15d558] ComputeGUReq took 32722283 microSec, 00:00:32.722283 (hh:mm:ss.us)
hostd.0: 2021-02-18T08:58:38.967Z warning hostd[2363484] [Originator@6876 sub=PropertyCollector opID=df15d9e3] ComputeGUReq took 33711838 microSec, 00:00:33.711838 (hh:mm:ss.us)
hostd.0: 2021-02-18T08:59:10.305Z warning hostd[2363486] [Originator@6876 sub=PropertyCollector opID=df15e011] ComputeGUReq took 31296218 microSec, 00:00:31.296218 (hh:mm:ss.us)
hostd.0: 2021-02-18T08:59:40.959Z warning hostd[2099962] [Originator@6876 sub=PropertyCollector opID=df15e4df] ComputeGUReq took 30617022 microSec, 00:00:30.617022 (hh:mm:ss.us)
hostd.0: 2021-02-18T09:00:13.123Z warning hostd[2100344] [Originator@6876 sub=PropertyCollector opID=df15e8ea] ComputeGUReq took 32125292 microSec, 00:00:32.125292 (hh:mm:ss.us)
hostd.0: 2021-02-18T09:00:47.364Z warning hostd[2363486] [Originator@6876 sub=PropertyCollector opID=df15ee77] ComputeGUReq took 34186593 microSec, 00:00:34.186593 (hh:mm:ss.us)
hostd.0: 2021-02-18T09:01:20.389Z warning hostd[2101496] [Originator@6876 sub=PropertyCollector opID=df15f38e] ComputeGUReq took 32985338 microSec, 00:00:32.985338 (hh:mm:ss.us)
hostd.0: 2021-02-18T09:01:58.146Z warning hostd[2363483] [Originator@6876 sub=PropertyCollector opID=df15f7f6] ComputeGUReq took 37715941 microSec, 00:00:37.715941 (hh:mm:ss.us)
hostd.0: 2021-02-18T09:02:59.078Z warning hostd[2099984] [Originator@6876 sub=PropertyCollector opID=df15fdbd] ComputeGUReq took 60894911 microSec, 00:01:00.894911 (hh:mm:ss.us)
hostd.0: 2021-02-18T09:03:30.581Z warning hostd[2101493] [Originator@6876 sub=PropertyCollector opID=df160692] ComputeGUReq took 31466527 microSec, 00:00:31.466527 (hh:mm:ss.us)
hostd.0: 2021-02-18T09:04:04.299Z warning hostd[2363484] [Originator@6876 sub=PropertyCollector opID=df160b6a] ComputeGUReq took 33678337 microSec, 00:00:33.678337 (hh:mm:ss.us)

Environment

VMware ESXi 6.7.x

Cause

due to the number of VMs , collecting VM properties time will add up causing the vmotion slowness/ failure behavior .

Resolution

This issue is resolved in VMware ESXi 6.7 Patch 06 (build number 18828794)

Workaround:
Reduce the number of VMs on host