Unable to execute host upgrade script while upgrading from ESXi 6.0 to 6.5 using VUM
search cancel

Unable to execute host upgrade script while upgrading from ESXi 6.0 to 6.5 using VUM

book

Article ID: 340289

calendar_today

Updated On:

Products

VMware vCenter Server VMware vSphere ESXi

Issue/Introduction

Symptoms:
  • VMware Update Manager (VUM) fails to upgrade ESXi 6.0 hosts when using custom image.
  • In the vmware-vum-server-log4cpp.log file, you see message similar to:
[2018-02-13 06:31:13:649 'HU-Upgrader' 139659605845760 INFO] [upgraderImpl, 536] Running 'prep.py' on host
[2018-02-13 06:31:14:733 'NfcClientWrapper' 139659605845760 INFO] [nfcClientWrapper, 154] Copying file: local = /tmp/upgradeQrUr7T/prep.py, remote = /tmp/vuaScript-YDn2Jb/prep.py
[2018-02-13 06:31:14:736 'NfcClientWrapper' 139659605845760 INFO] [nfcClientWrapper, 154] Copying file: local = /tmp/upgradeQrUr7T/metadata.zip, remote = /tmp/vuaScript-YDn2Jb/metadata.zip
[2018-02-13 06:31:14:742 'NfcClientWrapper' 139659605845760 INFO] [nfcClientWrapper, 154] Copying file: local = /tmp/upgradeQrUr7T/precheck.py, remote = /tmp/vuaScript-YDn2Jb/precheck.py
[2018-02-13 06:31:14:746 'NfcClientWrapper' 139659605845760 INFO] [nfcClientWrapper, 154] Copying file: local = /tmp/upgradeQrUr7T/esximage.zip, remote = /tmp/vuaScript-YDn2Jb/esximage.zip
[2018-02-13 06:31:22:645 'JobDispatcher' 139660196988672 DEBUG] [JobDispatcher, 407] The number of tasks: 10
[2018-02-13 06:31:31:688 'HU-Upgrader' 139659605845760 ERROR] [upgraderImpl, 440] Script execution failed on host: 10.241.95.51)
[2018-02-13 06:31:31:731 'AgentDeploy' 139659605845760 INFO] [agentDeploy, 172] Deploy agent, local installer = ./docroot/vci/vua/vua-uninst6/vua-uninst.sh, localSig = ./docroot/vci/vua/vua-uninst6/vua-uninst.sig
[2018-02-13 06:31:32:036 'NfcClientWrapper' 139659605845760 INFO] [nfcClientWrapper, 154] Copying file: local = ./docroot/vci/vua/vua-uninst6/vua-uninst.sh, remote = /tmp/vmware-root/ha-agentmgr/upgrade
[2018-02-13 06:31:32:149 'NfcClientWrapper' 139659605845760 INFO] [nfcClientWrapper, 154] Copying file: local = ./docroot/vci/vua/vua-uninst6/vua-uninst.sig, remote = /tmp/vmware-root/ha-agentmgr/upgrade.sig
[2018-02-13 06:31:32:419 'AgentDeploy' 139659605845760 INFO] [agentDeploy, 246] Agent installed
[2018-02-13 06:31:32:422 'SingleHostUpgradeRemediateTask.SingleHostUpgradeRemediateTask{512}' 139659605845760 ERROR] [singleHostUpgradeRemediateTask, 320] Error running check scripts on host: dfritesx03.dzbank.vrnet, host Id: host-4152, error: integrity.fault.HostUpgradeRunScriptFailure
[2018-02-13 06:31:32:423 'MaintenanceModeGuard' 139659605845760 INFO] [singleHostUpgradeRemediateTask, 367] Host was already in maintenance mode, skipping exit
[2018-02-13 06:31:32:423 'SingleHostUpgradeRemediateTask.SingleHostUpgradeRemediateTask{512}' 139659605845760 ERROR] [vciTaskBase, 557] Task execution has failed: integrity.fault.HostUpgradeRunScriptFailure
[2018-02-13 06:31:32:423 'VciRemediateTask.RemediateTask{494}' 139659605845760 DEBUG] [vciTaskBase, 741] New progress 45 for RemediateTask{494}
[2018-02-13 06:31:32:425 'ChainedTaskContainer.ChainedTaskContainer{511}' 139659605845760 INFO] [vciTaskBase, 588] A subTask finished: SingleHostUpgradeRemediateTask{512}
[2018-02-13 06:31:32:428 'ChainedTaskContainer.ChainedTaskContainer{510}' 139659605845760 INFO] [vciTaskBase, 588] A subTask finished: ChainedTaskContainer{511}
[2018-02-13 06:31:32:428 'VciRemediateTask.RemediateTask{494}' 139659605845760 DEBUG] [vciTaskBase, 741] New progress 45 for RemediateTask{494}
[2018-02-13 06:31:32:431 'VciTaskBase.VciClusterJobDispatcherTask{509}' 139659605845760 INFO] [vciTaskBase, 588] A subTask finished: ChainedTaskContainer{510}
[2018-02-13 06:31:32:431 'VciTaskBase.VciClusterJobDispatcherTask{509}' 139659605845760 INFO] [vciClusterJobSchedulerTask, 572] Found host host-4152
[2018-02-13 06:31:32:431 'VciTaskBase.VciClusterJobDispatcherTask{509}' 139659605845760 INFO] [vciClusterJobSchedulerTask, 612] Remediation failed due to non mmode failure
 
  • In the vua*.log file, you see messages similar to:
2018-02-13T06:32:57.810Z info vua[FFBC2B70] [Originator@6876 sub=VUA] Received request: <call function="runcustomscript"><params>/tmp/vuaScript-QiBTfm</params><params>prep.py</params><params>--ip=10.241.95.51</params></call>
2018-02-13T06:32:57.810Z info vua[FFBC2B70] [Originator@6876 sub=VUA] Received call for function runcustomscript
2018-02-13T06:32:57.810Z info vua[FFBC2B70] [Originator@6876 sub=VUA] Reboot after = false
2018-02-13T06:32:57.810Z info vua[FFBC2B70] [Originator@6876 sub=VUA] Invoking: "/tmp/vuaScript-QiBTfm/prep.py --ip=10.241.95.51"
2018-02-13T06:32:57.810Z info vua[FFBC2B70] [Originator@6876 sub=SysCommandPosix] ForkExec(/tmp/vuaScript-QiBTfm/prep.py) 39067
2018-02-13T06:33:06.518Z info vua[FFBC2B70] [Originator@6876 sub=VUA] Command '/tmp/vuaScript-QiBTfm/prep.py --ip=10.241.95.51' finished with exit status 1
--> stderr: --------
--> ERROR:root:Verify image profile authenticity failed: ('VMW_bootbank_ne1000_0.8.0-16vmw.650.1.26.5969303', 'The VIB VMW_bootbank_ne1000_0.8.0-16vmw.650.1.26.5969303 does not contain a signature.')
--> Traceback (most recent call last):
--> File "/tmp/vuaScript-QiBTfm/prep.py", line 1158, in <module>
--> sys.exit(main(sys.argv))
--> File "/tmp/vuaScript-QiBTfm/prep.py", line 1154, in main
--> prepareEsxiBootloader()
--> File "/tmp/vuaScript-QiBTfm/prep.py", line 998, in prepareEsxiBootloader
--> verifyProfileAuth(profile)
--> File "/tmp/vuaScript-QiBTfm/prep.py", line 764, in verifyProfileAuth
--> raise e
--> vmware.esximage.Errors.VibSigMissingError: ('VMW_bootbank_ne1000_0.8.0-16vmw.650.1.26.5969303', 'The VIB VMW_bootbank_ne1000_0.8.0-16vmw.650.1.26.5969303 does not contain a signature.')
-->
--> --------
-->
2018-02-13T06:33:06.518Z info vua[FFBC2B70] [Originator@6876 sub=VUA] Invoking: "/bin/rm -rf /tmp/vuaScript-QiBTfm"
2018-02-13T06:33:06.518Z info vua[FFBC2B70] [Originator@6876 sub=SysCommandPosix] ForkExec(/bin/rm) 39322
2018-02-13T06:33:06.570Z info vua[FFBC2B70] [Originator@6876 sub=VUA] Command '/bin/rm -rf /tmp/vuaScript-QiBTfm' finished with exit status 0
-->
2018-02-13T06:33:06.571Z info vua[FFBC2B70] [Originator@6876 sub=VUA] Response: <output><exitCode>1</exitCode><err>ERROR:root:Verify image profile authenticity failed: (&apos;VMW_bootbank_ne1000_0.8.0-16vmw.650.1.26.5969303&apos;, &apos;The VIB VMW_bootbank_ne1000_0.8.0-16vmw.650.1.26.5969303 does not contain a signature.&apos;)
--> Traceback (most recent call last):
--> File &quot;/tmp/vuaScript-QiBTfm/prep.py&quot;, line 1158, in &lt;module&gt;
--> sys.exit(main(sys.argv))
--> File &quot;/tmp/vuaScript-QiBTfm/prep.py&quot;, line 1154, in main
--> prepareEsxiBootloader()
--> File &quot;/tmp/vuaScript-QiBTfm/prep.py&quot;, line 998, in prepareEsxiBootloader
--> verifyProfileAuth(profile)
--> File &quot;/tmp/vuaScript-QiBTfm/prep.py&quot;, line 764, in verifyProfileAuth
--> raise e
--> vmware.esximage.Errors.VibSigMissingError: (&apos;VMW_bootbank_ne1000_0.8.0-16vmw.650.1.26.5969303&apos;, &apos;The VIB VMW_bootbank_ne1000_0.8.0-16vmw.650.1.26.5969303 does not contain a signature.&apos;)


Environment

VMware vCenter Server 6.0.x
VMware vSphere ESXi 6.0

Cause

This issue occurs when the boot image created using Power CLI 6.0 contains an unsigned VIB.

Note:  The 6.5 image builder includes signatures in ISOs, which are checked by VUM during the upgrade process.

Resolution

To resolve this issue, recreate install image using Power CLI 6.5  version.