vCLS deployment in a loop with error "The task was cancelled by a user" post changing the ESXi Server SSL Certificates
search cancel

vCLS deployment in a loop with error "The task was cancelled by a user" post changing the ESXi Server SSL Certificates

book

Article ID: 375634

calendar_today

Updated On:

Products

VMware vCenter Server

Issue/Introduction

  • vCLs VMs deployment is in a loop
  • Deploy OVF template task says, "The task was canceled by a user."
  • In the /var/log/vmware/eam/eam.log on the vCenter Server you see entries similar to the following

2022-09-30T15:13:42.302Z |  INFO | cluster-agent-0 | PushFiles.java | 87 | [NFC.File.Upload:fa925a248c4878b7] Pushing VM files through VmPushLease(id: session[52e844ac-f3db-9d28-51e3-d6e229f03ea1]52e0d83a-2e4a-b50b-9f0a-331472e0a7e3, Devices[(key: /vCLS-6e1a05cb-05f1-47fb-8747-0280edbd48e7/ParaVirtualSCSIController0:0, url: https://ESXiServerHostName/nfc/52dbbcdd-0199-f635-0000-00000002cc30/disk-0.vmdk, thumbprint: XX:XX:XX:XX:XX:XX:XX:3D:05:26:9E:A9:84:11:95:56:12:B2:3D:AB), (key: /vCLS-6e1a05cb-05f1-47fb-8747-0280edbd48e7/nvram, url: https://ESXiServerHostName/nfc/52dbbcdd-0199-f635-0000-00000002cc30/disk-1.nvram, thumbprint: XX:XX:XX:XX:XX:XX:XX:3D:05:26:9E:A9:84:11:95:56:12:B2:3D:AB)], HostMap[Datastore(key: https://ESXiServerHostName/nfc/52dbbcdd-0199-f635-0000-00000002cc30/ , hosts[(url: https://ESXiServerHostName/nfc/52dbbcdd-0199-f635-0000-00000002cc30/ , thumbprint: XX:XX:XX:XX:XX:XX:XX:3D:05:26:9E:A9:84:11:95:56:12:B2:3D:AB)])])
2022-09-30T15:13:42.303Z |  INFO | cluster-agent-0 | PushFiles.java | 118 | [NFC.File.Upload:fa925a248c4878b7] Start upload of 1 VM files
2022-09-30T15:13:42.303Z |  INFO | cluster-agent-0 | OpId.java | 37 | [/vCLS-6e1a05cb-05f1-47fb-8747-0280edbd48e7/ParaVirtualSCSIController0:0:fea8cb2ae89d0225] created from [NFC.File.Upload:fa925a248c4878b7]
2022-09-30T15:13:42.303Z |  INFO | cluster-agent-0 | OpId.java | 37 | [URLChecker->getURLProperties:b5ac7b5d30291cfb] created from [/vCLS-6e1a05cb-05f1-47fb-8747-0280edbd48e7/ParaVirtualSCSIController0:0:fea8cb2ae89d0225]
2022-09-30T15:13:42.303Z |  INFO | cluster-agent-0 | HttpTransfer.java | 114 | [/vCLS-6e1a05cb-05f1-47fb-8747-0280edbd48e7/ParaVirtualSCSIController0:0:fea8cb2ae89d0225] Start transfer from file:/storage/lifecycle/vmware-hdcs/photon-ova-disk1.vmdk to https://ESXiServerHostName/nfc/52dbbcdd-0199-f635-0000-00000002cc30/disk-0.vmdkFile size: 75195904
2022-09-30T15:13:42.304Z |  INFO | cluster-agent-0 | OpId.java | 37 | [VM_UPLOAD_CONNECTION:e727578dcf3a0680] created from [/vCLS-6e1a05cb-05f1-47fb-8747-0280edbd48e7/ParaVirtualSCSIController0:0:fea8cb2ae89d0225]
2022-09-30T15:13:42.306Z |  INFO | cluster-agent-0 | OpId.java | 37 | [VM_STREAM_TRANSFER_OP:8c4534a880ed4602] created from [/vCLS-6e1a05cb-05f1-47fb-8747-0280edbd48e7/ParaVirtualSCSIController0:0:fea8cb2ae89d0225]
2022-09-30T15:13:42.306Z |  INFO | cluster-agent-0 | UploadConnection.java | 122 | [VM_UPLOAD_CONNECTION:e727578dcf3a0680] Constructing upload request
2022-09-30T15:13:42.306Z |  INFO | cluster-agent-0 | RouteProvider.java | 95 | [VM_UPLOAD_CONNECTION:e727578dcf3a0680] https://ESXiServerHostName/nfc/52dbbcdd-0199-f635-0000-00000002cc30/disk-0.vmdk convertion to use dynamic remote connection route completed. Result: Route(url:http://localhost:1080/external-tp/http1/ESXiServerHostName/443/6a712ed5347ad13d05269ea98411955612b23dab/nfc/52dbbcdd-0199-f635-0000-00000002cc30/disk-0.vmdk)
2022-09-30T15:13:42.306Z |  INFO | cluster-agent-0 | VmdkRequestProducerFactory.java | 59 | [VM_UPLOAD_CONNECTION:e727578dcf3a0680] VmUploadRequestProducer[host=http://localhost:1080, request=POST http://localhost:1080/external-tp/http1/ESXiServerHostName/443/6a712ed5347ad13d05269ea98411955612b23dab/nfc/52dbbcdd-0199-f635-0000-00000002cc30/disk-0.vmdk HTTP/1.1] created
2022-09-30T15:13:42.307Z |  INFO | VM-push-dispatcher-22 | VmUploadContentProducer.java | 87 | [VM_STREAM_TRANSFER_OP:8c4534a880ed4602] Opening input stream channel.
2022-09-30T15:13:42.322Z |  INFO | VM-push-dispatcher-22 | VmUploadContentProducer.java | 147 | [VM_STREAM_TRANSFER_OP:8c4534a880ed4602] Closing input resources finished. Total transferred bytes:1757184
2022-09-30T15:13:42.322Z |  INFO | cluster-agent-0 | UploadConnection.java | 162 | [VM_UPLOAD_CONNECTION:e727578dcf3a0680] Closing connection to https://ESXiServerHostName/nfc/52dbbcdd-0199-f635-0000-00000002cc30/disk-0.vmdk
2022-09-30T15:13:42.323Z |  INFO | cluster-agent-0 | UploadConnection.java | 168 | [VM_UPLOAD_CONNECTION:e727578dcf3a0680] The connection was closed successfully
2022-09-30T15:13:42.323Z |  INFO | cluster-agent-0 | PushFiles.java | 139 | [NFC.File.Upload:fa925a248c4878b7] Upload failed

Environment

VMware vCenter Server 7.0.x

VMware vCenter Server 8.0.x

Cause

  • The issue is caused due to incorrect ESXi Server thumbprint used by EAM (ESX Agent Manager)
  • EAM uses vCenter Server data as source for this thumbprint information
  • In cases of ESXi Server SSL Certificates have been changed, the thumbprints stored by vCenter Server can become outdated/stale

Resolution

  1. Connect to vCenter Server using vSphere Client with an account having inventory management privileges
  2. Disconnect and Reconnect each ESXi Server one by one in the cluster where the vCLS deployment is failing

Post reconnecting all ESXi, vCLS deployment task will succeed. 

 

Additional Information

ESXi Server SSL Certificate thumbprint gets updated when a host is newly connected to the vCenter Server inventory or an existing ESXi Server is disconnected and connected back.

This environment may also see a failure in configuring vSphere Availability. Please see https://knowledge.broadcom.com/external/article?articleNumber=345414 for more details.

Powered by Wolken Software