vCLS deployment in a loop with error "The task was cancelled by a user" post changing the ESXi Server SSL Certificates
search cancel

vCLS deployment in a loop with error "The task was cancelled by a user" post changing the ESXi Server SSL Certificates

book

Article ID: 375634

calendar_today

Updated On:

Products

VMware vCenter Server

Issue/Introduction

  • vCLs VMs deployment is in a loop
  • Deploy OVF template task says, "The task was canceled by a user."
  • In the /var/log/vmware/eam/eam.log on the vCenter Server you see entries similar to the following
    YYYY-MM-DDTHH:MM:SS.302Z |  INFO | cluster-agent-0 | PushFiles.java | 87 | [NFC.File.Upload:fa925a248c4878b7] Pushing VM files through VmPushLease(id: session[52e844ac-f3db-9d28-51e3-d6e229f03ea1]52e0d83a-2e4a-b50b-9f0a-331472e0a7e3, Devices[(key: /vCLS-6e1a05cb-05f1-47fb-8747-0280edbd48e7/ParaVirtualSCSIController0:0, url: https://ESXiServerHostName/nfc/52dbbcdd-0199-f635-0000-00000002cc30/disk-0.vmdk, thumbprint: XX:XX:XX:XX:XX:XX:XX:3D:05:26:9E:A9:84:11:95:56:12:B2:3D:AB), (key: /vCLS-6e1a05cb-05f1-47fb-8747-0280edbd48e7/nvram, url: https://ESXiServerHostName/nfc/52dbbcdd-0199-f635-0000-00000002cc30/disk-1.nvram, thumbprint: XX:XX:XX:XX:XX:XX:XX:3D:05:26:9E:A9:84:11:95:56:12:B2:3D:AB)], HostMap[Datastore(key: https://ESXiServerHostName/nfc/52dbbcdd-0199-f635-0000-00000002cc30/ , hosts[(url: https://ESXiServerHostName/nfc/52dbbcdd-0199-f635-0000-00000002cc30/ , thumbprint: XX:XX:XX:XX:XX:XX:XX:3D:05:26:9E:A9:84:11:95:56:12:B2:3D:AB)])])
YYYY-MM-DDTHH:MM:SS.303Z |  INFO | cluster-agent-0 | PushFiles.java | 118 | [NFC.File.Upload:fa925a248c4878b7] Start upload of 1 VM files
YYYY-MM-DDTHH:MM:SS.303Z |  INFO | cluster-agent-0 | OpId.java | 37 | [/vCLS-6e1a05cb-05f1-47fb-8747-0280edbd48e7/ParaVirtualSCSIController0:0:fea8cb2ae89d0225] created from [NFC.File.Upload:fa925a248c4878b7]
YYYY-MM-DDTHH:MM:SS.303Z |  INFO | cluster-agent-0 | OpId.java | 37 | [URLChecker->getURLProperties:b5ac7b5d30291cfb] created from [/vCLS-6e1a05cb-05f1-47fb-8747-0280edbd48e7/ParaVirtualSCSIController0:0:fea8cb2ae89d0225]
YYYY-MM-DDTHH:MM:SS.303Z |  INFO | cluster-agent-0 | HttpTransfer.java | 114 | [/vCLS-6e1a05cb-05f1-47fb-8747-0280edbd48e7/ParaVirtualSCSIController0:0:fea8cb2ae89d0225] Start transfer from file:/storage/lifecycle/vmware-hdcs/photon-ova-disk1.vmdk to https://ESXiServerHostName/nfc/52dbbcdd-0199-f635-0000-00000002cc30/disk-0.vmdkFile size: 75195904
YYYY-MM-DDTHH:MM:SS.304Z |  INFO | cluster-agent-0 | OpId.java | 37 | [VM_UPLOAD_CONNECTION:e727578dcf3a0680] created from [/vCLS-6e1a05cb-05f1-47fb-8747-0280edbd48e7/ParaVirtualSCSIController0:0:fea8cb2ae89d0225]
YYYY-MM-DDTHH:MM:SS.306Z |  INFO | cluster-agent-0 | OpId.java | 37 | [VM_STREAM_TRANSFER_OP:8c4534a880ed4602] created from [/vCLS-6e1a05cb-05f1-47fb-8747-0280edbd48e7/ParaVirtualSCSIController0:0:fea8cb2ae89d0225]
YYYY-MM-DDTHH:MM:SS.306Z |  INFO | cluster-agent-0 | UploadConnection.java | 122 | [VM_UPLOAD_CONNECTION:e727578dcf3a0680] Constructing upload request
YYYY-MM-DDTHH:MM:SS.306Z |  INFO | cluster-agent-0 | RouteProvider.java | 95 | [VM_UPLOAD_CONNECTION:e727578dcf3a0680] https://ESXiServerHostName/nfc/52dbbcdd-0199-f635-0000-00000002cc30/disk-0.vmdk convertion to use dynamic remote connection route completed. Result: Route(url:http://localhost:1080/external-tp/http1/ESXiServerHostName/443/6a712ed5347ad13d05269ea98411955612b23dab/nfc/52dbbcdd-0199-f635-0000-00000002cc30/disk-0.vmdk)
YYYY-MM-DDTHH:MM:SS.306Z |  INFO | cluster-agent-0 | VmdkRequestProducerFactory.java | 59 | [VM_UPLOAD_CONNECTION:e727578dcf3a0680] VmUploadRequestProducer[host=http://localhost:1080, request=POST http://localhost:1080/external-tp/http1/ESXiServerHostName/443/6a712ed5347ad13d05269ea98411955612b23dab/nfc/52dbbcdd-0199-f635-0000-00000002cc30/disk-0.vmdk HTTP/1.1] created
YYYY-MM-DDTHH:MM:SS.307Z |  INFO | VM-push-dispatcher-22 | VmUploadContentProducer.java | 87 | [VM_STREAM_TRANSFER_OP:8c4534a880ed4602] Opening input stream channel.
YYYY-MM-DDTHH:MM:SS.322Z |  INFO | VM-push-dispatcher-22 | VmUploadContentProducer.java | 147 | [VM_STREAM_TRANSFER_OP:8c4534a880ed4602] Closing input resources finished. Total transferred bytes:1757184
YYYY-MM-DDTHH:MM:SS.322Z |  INFO | cluster-agent-0 | UploadConnection.java | 162 | [VM_UPLOAD_CONNECTION:e727578dcf3a0680] Closing connection to https://ESXiServerHostName/nfc/52dbbcdd-0199-f635-0000-00000002cc30/disk-0.vmdk
YYYY-MM-DDTHH:MM:SS.323Z |  INFO | cluster-agent-0 | UploadConnection.java | 168 | [VM_UPLOAD_CONNECTION:e727578dcf3a0680] The connection was closed successfully
YYYY-MM-DDTHH:MM:SS.323Z |  INFO | cluster-agent-0 | PushFiles.java | 139 | [NFC.File.Upload:fa925a248c4878b7] Upload failed

Environment

VMware vCenter Server 7.0.x

VMware vCenter Server 8.0.x

Cause

  • The issue is caused due to incorrect ESXi Server thumbprint used by EAM (ESX Agent Manager)
  • EAM uses vCenter Server data as source for this thumbprint information
  • In cases of ESXi Server SSL Certificates have been changed, the thumbprints stored by vCenter Server can become outdated/stale

Resolution

  1. Connect to vCenter Server using vSphere Client with an account having inventory management privileges
  2. Disconnect and Reconnect each ESXi Server one by one in the cluster where the vCLS deployment is failing

Note: Post reconnecting all ESXi, vCLS deployment task will succeed. 

Additional Information

ESXi Server SSL Certificate thumbprint gets updated when a host is newly connected to the vCenter Server inventory or an existing ESXi Server is disconnected and connected back.

This environment may also see a failure in configuring vSphere Availability. Please see HA configuration is stuck at the "Election" state and doesn't proceed further for a set of hosts for more details.

Powered by Wolken Software