HCX - DRS power on failed for Virtual Machine 'vm-####’ due to (vim.fault.InsufficientNetworkCapacity)
Article ID: 373892
Updated On:
Products
Issue/Introduction
Symptoms:
When a Bulk migration is attempted on a VM which has Network adapter reservation set, migration validation may pass; however, during the final switchover phase of the migration when attempting to power on the VM at the target site the following error may be experienced leading to migration failure:
Error: DRS power on failed for Virtual Machine 'vm-####’ due to (vim.fault.InsufficientNetworkCapacity)Cause
Network I/O Control reservation for affected VM (set with 100 Mbit/s) was keeping the VM from being powered on (from powered off state).
Resolution
Before migrating a VM, power it off, change the Network Adapter Reservation from "100" to "0" (disable network reservation for this VM) and click save. Then perform a Bulk Migration.
Additional Information
- The below logs indicate the ESXi host does not have sufficient network capacity to satisfy the reservation:
app.log:
2024-07-26 19:36:34.163 UTC [ReplicationTransferService_SvcThread-373, Ent: HybridityAdmin, , TxId: TxId: ########-####-####-1e1f8c4235ae] INFO c.v.v.h.adapters.vcenter.VmxUtils- Initiate downloading vmx /########-####-####-####-946dae8d4684/########-Test1.vmx for from datastore vsanDatastore on host ##.##.###.132
2024-07-26 19:36:50.930 UTC [NetworkStretchService_SvcThread-760, j: ecbf7658, vm: vm-####, vnic: 0, portKey: ########-####-####-37d2c4aa4eb8, PR, TxId: ########-####-####-####-72acc86054bf] INFO c.v.h.n.util.NetworkExtensionUtils- setTaskInVMStretchContext - vcInstanceId ########-####-####-####-a433ad25bda7 vmMoref vm-#### taskWithIntent {"status":"RUNNING","progress":60,"message":"Configuring VM to use Remote Router as relevant Ip address is not present on VM or not detected by VMtools.","taskId":"########-####-####-####-54b984dbed7a"}
2024-07-26 19:36:50.933 UTC [NetworkStretchService_SvcThread-760, j: ecbf7658, vm: vm-####, vnic: 0, portKey: ########-####-####-####-37d2c4aa4eb8, PR, TxId: ########-####-####-####-72acc86054bf] INFO c.v.h.n.util.NetworkExtensionUtils- Successfully set taskInfo for vm vm-####.
2024-07-26 19:36:57.221 UTC [MigrationService_SvcThread-46, Ent: HybridityAdmin, , TxId: TxId: ########-####-####-####-1e1f8c4235ae] INFO c.v.v.h.s.v.m.jobs.DrsPowerOnJob- Initiated DRS Power On for Virtual Machine 'vm-####' via task 'task-2692'
2024-07-26 19:36:57.578 UTC [MigrationService_SvcThread-46, Ent: HybridityAdmin, , TxId: TxId: ########-####-####-####-1e1f8c4235ae] ERROR c.v.v.h.s.v.m.jobs.DrsPowerOnJob- DRS power on failed for Virtual Machine 'vm-####'
com.vmware.vim.binding.vim.fault.InsufficientNetworkCapacity: The host does not have sufficient network capacity to satisfy the reservation.
2024-07-26 19:36:57.603 UTC [ReplicationTransferService_SvcThread-383, Ent: HybridityAdmin, , TxId: TxId: ########-####-####-####-1e1f8c4235ae] INFO c.v.h.s.r.jobs.InstantiateVmJob- Switchover ########-####-####-####-4d787a392cb0 running in state COMPLETE_VM_INSTANTIATION
vpxd.log:
2024-07-26T19:36:35.230Z warning vpxd[41336] [Originator@6876 sub=vmomi.soapStub[61] opID=TaskLoop-host-1017] SOAP request returned HTTP failure; <SSL(<io_obj p:0x00007f5b7c69b638, h:94, <TCP '##.##.###.2 :
54950'>, <TCP '##.##.###.132 : 443'>>), /vpxa>, method: waitForUpdates; code: 500(Internal Server Error)
2024-07-26T19:36:35.285Z error vpxd[40999] [Originator@6876 sub=DvsUtils opID=TxId: ########-####-####-####-1e1f8c4235ae-fd-01-421cd3f8] Portgroup [dvportgroup-3042] not found
2024-07-26T19:36:35.295Z error vpxd[41012] [Originator@6876 sub=coreanchor opID=TxId: ########-####-####-####-a414-1e1f8c4235ae-fd-01] Dvs or dvpg from vnic backing of ########-Test1] not found in the datacenter. It will contain invalid backing
--> } to VM ds:///vmfs/volumes/vsan:##########-###############/########-####-####-####-946dae8d4684/########-Test1.vmx on host ##.##.###.132
2024-07-26T19:36:46.425Z info vpxd[14090] [Originator@6876 sub=pbm opID=TxId: f798cf54-af8c-466c-a414-1e1f8c4235ae-b6-01] Reconfigure profile association for vm vm-####
2024-07-26T19:36:46.461Z info vpxd[14090] [Originator@6876 sub=VmProv opID=TxId: ########-####-####-####-1e1f8c4235ae-b6-01] Action timings:
Also, the insufficient Network Capacity showing for those 3 hosts on Cloud:
2024-07-26T19:36:57.225Z info vpxd[14087] [Originator@6876 sub=cdrsPlmt opID=TxId: ########-####-####-####-1e1f8c4235ae-4e-01] Vm [vim.VirtualMachine:vm-####,########-Test1] failed constraint check true on host [vim.HostSystem:host-1017,esxi-#####.########.##-########.###.goog] with <obj xmlns:xsd="http://www.w3.org/2001/XMLSchema" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns="urn:vim25" versionId="7.0.3.0" xsi:type="LocalizedMethodFault"><fault xsi:type="InsufficientNetworkCapacity"><faultMessage><key>com.vmware.drs.constraints.network.noPnicsFound</key><arg><key>host</key><value xsi:type="xsd:string">esxi-#####.########.##-########.###.goog</value></arg></faultMessage></fault><localizedMessage></localizedMessage></obj>
2024-07-26T19:36:57.225Z info vpxd[14087] [Originator@6876 sub=cdrsPlmt opID=TxId: ########-####-####-####-1e1f8c4235ae-4e-01] Vm [vim.VirtualMachine:vm-####,########-Test1] failed constraint check true on host [vim.HostSystem:host-1010,esxi-#####.########.##-########.###.goog] with <obj xmlns:xsd="http://www.w3.org/2001/XMLSchema" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns="urn:vim25" versionId="7.0.3.0" xsi:type="LocalizedMethodFault"><fault xsi:type="InsufficientNetworkCapacity"><faultMessage><key>com.vmware.drs.constraints.network.noPnicsFound</key><arg><key>host</key><value xsi:type="xsd:string">esxi-#####.########.##-########.###.goog</value></arg></faultMessage></fault><localizedMessage></localizedMessage></obj>
2024-07-26T19:36:57.225Z info vpxd[14087] [Originator@6876 sub=cdrsPlmt opID=TxId: ########-####-####-####-1e1f8c4235ae-4e-01] Vm [vim.VirtualMachine:vm-####,########-Test1] failed constraint check true on host [vim.HostSystem:host-1016,esxi-#####.########.##-########.###.goog] with <obj xmlns:xsd="http://www.w3.org/2001/XMLSchema" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns="urn:vim25" versionId="7.0.3.0" xsi:type="LocalizedMethodFault"><fault xsi:type="InsufficientNetworkCapacity"><faultMessage><key>com.vmware.drs.constraints.network.noPnicsFound</key><arg><key>host</key><value xsi:type="xsd:string">esxi-#####.########.##-########.###.goog</value></arg></faultMessage></fault><localizedMessage></localizedMessage></obj>
Feedback
