"An error occurred while trying to load data. This could be due to temporary outage. You can retry the operation by clicking retry button" when attempting to vmotion or clone a VM.

Products

• VMware vSphere ESXi
• VMware vCenter Server

Issue/Introduction

1. When attempting to clone or vmotion a virtual machine within the cluster, it fails to go beyond the task review with the below error message.

Error Loading Data
 
An error occurred while trying to load data. This could be due to temporary outage. You can retry the operation by clicking retry button.

Cannot read properties of null (reading 'datastoreItems')

TypeError: Cannot read properties of null (reading 'datastoreItems') at https://<VC-FQDN>/ui/static/resources14321349/ng-next-app/src_app_plugins_vm-ui_src_vm-provisioning_public_api_ts.js:1:220233 at https://<VC-FQDN>/ui/static/resources14321349/ng-next-app/main.js:18:856127 at l._next (https://<VC-FQDN>/ui/static/resources14321349/ng-next-app/main.js:18:850706) at l.next (https://<VC-FQDN>/ui/static/resources14321349/ng-next-app/main.js:18:839487) at l._next (https://<VC-FQDN>/ui/static/resources14321349/ng-next-app/main.js:18:839792) at l.next (https://<VC-FQDN>/ui/static/resources14321349/ng-next-app/main.js:18:839487) at https://<VC-FQDN>/ui/static/resources14321349/ng-next-app/main.js:18:856120 at l._next (https://<VC-FQDN>/ui/static/resources14321349/ng-next-app/main.js:18:850706) at l.next (https://<VC-FQDN>/ui/static/resources14321349/ng-next-app/main.js:18:839487) at https://<VC-FQDN>/ui/static/resources14321349/ng-next-app/main.js:18:854300

2. For the ESXi Hosts where the VMs' reside, the vpxd and journalctl logs of the vCenter server are full of "Cannot complete login due to an incorrect username or password" events.

Per vpxd logs-

SOAP request returned HTTP failure; <<io_obj p:0x00007faab86436d8, h:18, <UNIX ''>, <UNIX '/var/run/envoy-hgw/hgw-pipe'>>, /hgw/host-422553/sdk>, method: login; code: 500(Internal Server Error); fault: (vim.fault.InvalidLogin) {
-->    faultCause = (vmodl.MethodFault) null,
-->    faultMessage = <unset>
-->    msg = "Received SOAP response fault from [<<io_obj p:0x00007faab86436d8, h:18, <UNIX ''>, <UNIX '/var/run/envoy-hgw/hgw-pipe'>>, /hgw/host-422553/sdk>]: login
--> Cannot complete login due to an incorrect user name or password."

Per journalctl logs-

<vCenter server FQDN> vpxd[]: Event [] [1-1] [] [vim.event.HostSyncFailedEvent] [error] [] [15864737] [Cannot synchronize host <ESXi-Host-FQDN>. \
Cannot complete login due to an incorrect user name or password.]
<vCenter server FQDN> vpxd[]: Event [] [1-1] [] [vim.event.HostSyncFailedEvent] [error] [] [15864737] [Cannot synchronize host <ESXi-Host-FQDN>. \
Cannot complete login due to an incorrect user name or password.]

 

Per Dataservice.log-

[ERROR] data-service-pool        DataServiceImpl [queryId: qb-<ID>] Error occurred while executing query:
DataService is called by provider invocation: q-<ID>:h5ui-getProperties:urn:vmomi:VirtualMachine:vm-<ID>:<MobRefID>:VmStorageLocatorProper
tyProvider:
Parent viseBatch: q-<ID>:h5ui-getProperties:urn:vmomi:VirtualMachine:vm-<ID>:<MobRefID>:VmStorageLocatorPropertyProvider

Environment

VMware vSphere ESXi
VMware vCenter Server

Cause

This issue occurs if the vCenter server appliance was restored from a previously taken snapshot and the "vpxuser" password on the problematic ESXi host got updated between the time of snapshot and the time of restore. As a result, the password of the system user "vpxuser" on the ESXi host and in the vCenter server database goes out of sync. 

Resolution

"Disconnect" and "Reconnect" the affected Host in the vSphere UI.