When attempting to remove a VMkernel, the operation is timing out.
Article ID: 426792
Updated On:
Products
Issue/Introduction
The task to remove a VMkernel returns the following message:
Operation failed!
Method vim.host.NetworkSystem.removeVirtualNic threw undeclared fault of type vim.fault.Timedout
Cause:Operation timed out.
The vpxd logs on the vCenter may list similar entries:
2026-##-##T##:##:##.###-##:## error vpxd[12427] [Originator@#### sub=hostMethod opID=########-#######-auto-#####-##:########-##] Timed out waiting for [removeVirtualNic] API from host [[vim.HostSystem:host-######,<Host_FQDN>]]
2026-##-##T##:##:##.###-##:## info vpxd[12427] [Originator@#### sub=IO.Http opID=########-#######-auto-#####-##:########-##] Terminating user agent request; <io_obj p:0x00007fac8c00dbd8, h:81, <UNIX ''>, <UNIX '/var/run/envoy-hgw/hgw-pipe'>>, N7Vmacore17CanceledExceptionE(Operation was canceled)
--> [context]zKq7AVECAQAAAPONbgEWdnB4ZAAAowFTbGlidm1hY29yZS5zbwAA/gdCAB8vQwC+i0oAEdJHAd8fIWxpYnZtb21pLnNvAILEsF4CdnB4ZACCArNeAoJnHy0Bg255YQFsaWJ2aW0tdHlwZXMuc28AgjEVggIBTXUcgmjvXwKCsKCAAoL7sIACgu/DfwKC3pqAAgAE3DcAFzU4ALv/UASwjgBsaWJwdGhyZWFkLnNvLjAABe/6D2xpYmMuc28uNgA=[/context]
2026-##-##T##:##:##.###-##:## info vpxd[12427] [Originator@#### sub=IO.Http opID=########-#######-auto-#####-##:########-##] Set user agent error; state: 3, <io_obj p:0x00007fac8c00dbd8, h:81, <UNIX ''>, <UNIX '/var/run/envoy-hgw/hgw-pipe'>>, N7Vmacore17CanceledExceptionE(Operation was canceled)
--> [context]zKq7AVECAQAAAPONbgEWdnB4ZAAAowFTbGlidm1hY29yZS5zbwAA/gdCAB8vQwC+i0oAEdJHAd8fIWxpYnZtb21pLnNvAILEsF4CdnB4ZACCArNeAoJnHy0Bg255YQFsaWJ2aW0tdHlwZXMuc28AgjEVggIBTXUcgmjvXwKCsKCAAoL7sIACgu/DfwKC3pqAAgAE3DcAFzU4ALv/UASwjgBsaWJwdGhyZWFkLnNvLjAABe/6D2xpYmMuc28uNgA=[/context]
2026-##-##T##:##:##.###-##:## error vpxd[1802136] [Originator@#### sub=IO.Http opID=########-#######-auto-#####-##:########-##] User agent failed to send request; (null), N7Vmacore17CanceledExceptionE(Operation was canceled)
--> [context]zKq7AVECAQAAAPONbgEWdnB4ZAAAowFTbGlidm1hY29yZS5zbwAA/gdCAB8vQwC+i0oAEdJHAd8fIWxpYnZtb21pLnNvAILEsF4CdnB4ZACCArNeAoJnHy0Bg255YQFsaWJ2aW0tdHlwZXMuc28AgjEVggIBTXUcgmjvXwKCsKCAAoL7sIACgu/DfwKC3pqAAgAE3DcAFzU4ALv/UASwjgBsaWJwdGhyZWFkLnNvLjAABe/6D2xpYmMuc28uNgA=[/context]
2026-##-##T##:##:##.###-##:## error vpxd[856223] [Originator@#### sub=hostMethod opID=########-#######-auto-#####-##:########-##] Host call possibly disconnected for host [[vim.HostSystem:host-######,<Host_FQDN>]] for VC with exception [Operation was canceled]
2026-##-##T##:##:##.###-##:## warning vpxd[12427] [Originator@#### sub=Vmomi opID=########-#######-auto-#####-##:########-##] VMOMI activation LRO failed; <<5292b0e6-619e-3d53-67c3-b3a49db53085, <TCP '127.0.0.1 : 8085'>, <TCP '127.0.0.1 : 49066'>>, networkSystem-######, vim.host.NetworkSystem.removeVirtualNic, <vim.version.v8_0_3_0, internal, 8.0.3.0>, {stm: {<io_obj p:0x00007facc00e5570, h:432, <TCP '127.0.0.1 : 8085'>, <TCP '127.0.0.1 : 49028'>>, id: 43736193, state(in/out): 3/1}, session: <5292b0e6-619e-3d53-67c3-b3a49db53085, <TCP '127.0.0.1 : 8085'>, <TCP '127.0.0.1 : 49066'>>, req: {POST, /sdk}}>, N3Vim5Fault8Timedout9ExceptionE(Fault cause: vim.fault.Timedout
--> )
--> [context]zKq7AVECAQAAAPONbgEWdnB4ZAAAowFTbGlidm1hY29yZS5zbwAA/gdCAB8vQwCMiUqBU0U6AWxpYnZpbS10eXBlcy5zbwCBfmM6AYHu5TsBgmmzXgJ2cHhkAIJnHy0BgW55YQGCMRWCAgNNdRxsaWJ2bW9taS5zbwCCaO9fAoKwoIACgvuwgAKC78N/AoLemoACAATcNwAXNTgAu/9QBLCOAGxpYnB0aHJlYWQuc28uMAAF7/oPbGliYy5zby42AA==[/context]
2026-##-##T##:##:##.###-##:## error vpxd[12427] [Originator@#### sub=Req@internalvim25... opID=########-#######-auto-#####-##:########-##] Method vim.host.NetworkSystem.removeVirtualNic threw undeclared fault of type vim.fault.Timedout
2026-##-##T##:##:##.###-##:## info vpxd[12427] [Originator@#### sub=vpxLro opID=########-#######-auto-#####-##:########-##] [VpxLRO] -- FINISH task-#######
2026-##-##T##:##:##.###-##:## error vpxd[12427] [Originator@#### sub=Default opID=########-#######-auto-#####-##:########-##] [VpxLRO] -- ERROR task-####### -- 5292b0e6-619e-3d53-67c3-b3a49db53085(52414e15-5c0f-f3df-edd0-1519f1ad3a22) -- networkSystem-###### -- vim.host.NetworkSystem.removeVirtualNic: :vim.fault.Timedout
--> Result:
--> (vim.fault.Timedout) {
--> faultCause = (vmodl.MethodFault) null,
--> faultMessage = <unset>
--> msg = ""
--> }
--> Args:
-->
--> Arg device:
--> "vmk#"
Environment
- vSphere 8.x
Cause
The API call from the vCenter to remove the virtual NIC used by the VMkernel on the specific host timed out as the host did not respond to the call.
Resolution
Open a support case with Broadcom Support to continue troubleshooting the issue.
Feedback
