ESXi Host update through vLCM Fails (Image based)
search cancel

ESXi Host update through vLCM Fails (Image based)

book

Article ID: 376194

calendar_today

Updated On:

Products

VMware vSphere ESXi

Issue/Introduction

ESXi Host update/upgrade fails through vLCM and can fail through command line: Image compliance error seen in UI similar to below:

 

In vCenter server logs may see errors similar to below: 

/var/log/vmware/vmware-updatemgr/vum-server/vmware-vum-server-*.log

[YYYY-MM-DDTHH:MM:SS] info vmware-vum-server[10771] [Originator@6876 sub=com.vmware.vcIntegrity.lifecycle.DesiredScanClusterTask] [Task, 457] Task:com.vmware.vcIntegrity.lifecycle.DesiredScanClusterTask ID:111111111111-9503-d3c1-1fc2-6d
b0b901741d. Cluster image compliance result for cluster - Cluster1 (domain-c4) : [

{
--> "STRUCTURE": {
--> "map-entry": {
--> "key": "host-1",
--> "value": {
--> "STRUCTURE": {
--> "com.vmware.esx.settings.host_compliance": {
--> "add_on": {
--> "STRUCTURE": {
--> "com.vmware.esx.settings.add_on_compliance": {
--> "current": {
--> "OPTIONAL": {
--> "STRUCTURE": {
--> "com.vmware.esx.settings.add_on_info": {
--> "details": {
--> "OPTIONAL": {
--> "STRUCTURE": {
--> "com.vmware.esx.settings.add_on_details": {
--> "display_name": "HPE Customization for HPE Servers",
--> "display_version": "703.0.0.11.5.0-6",
--> "vendor": "Hewlett Packard Enterprise"
--> }
--> }
--> }
--> },
--> "name": "HPE-Custom-AddOn",
--> "version": "703.0.0.11.5.0-6"
--> }
--> }
--> }

--> "status": "NON_COMPLIANT",
--> "target": {
--> "OPTIONAL": {
--> "STRUCTURE": {
--> "com.vmware.esx.settings.add_on_info": {
--> "details": {
--> "OPTIONAL": {
--> "STRUCTURE": {
--> "com.vmware.esx.settings.add_on_details": {
--> "display_name": "HPE Customization for HPE Servers",
--> "display_version": "703.0.0.11.6.0-5",
--> "vendor": "Hewlett Packard Enterprise"
--> }
--> }
--> }
--> },
--> "name": "HPE-Custom-AddOn",
--> "version": "703.0.0.11.6.0-5"

On ESXi host may see similar to below: 

/var/run/log/lifecycle.log

[YYYY-MM-DDTHH:MM:SS] lifecycle: 3817790: imagemanagerctl:152 ERROR [InstallationError] Failed to query file system stats: Errors: Unable to complete Sysinfo operation. Please see the VMkernel log file for more details.: Vmkernel modu
le necessary for this vsi call not loaded
[YYYY-MM-DDTHH:MM:SS] lifecycle: 3817790: imagemanagerctl:157 ERROR Traceback (most recent call last):
[YYYY-MM-DDTHH:MM:SS] lifecycle: 3817790: imagemanagerctl:157 ERROR File "/tmp/esx-update-3817790/lib64/python3.8/site-packages/vmware/esximage/Utils/HostInfo.py", line 225, in _getFileSystemList
[YYYY-MM-DDTHH:MM:SS] lifecycle: 3817790: imagemanagerctl:157 ERROR File "/lib64/python3.8/site-packages/esxutils.py", line 220, in runCli
[YYYY-MM-DDTHH:MM:SS] lifecycle: 3817790: imagemanagerctl:157 ERROR esxutils.EsxcliError: Errors:
[YYYY-MM-DDTHH:MM:SS] lifecycle: 3817790: imagemanagerctl:157 ERROR Unable to complete Sysinfo operation. Please see the VMkernel log file for more details.: Vmkernel module necessary for this vsi call not loaded
[YYYY-MM-DDTHH:MM:SS] lifecycle: 3817790: imagemanagerctl:157 ERROR
[YYYY-MM-DDTHH:MM:SS] lifecycle: 3817790: imagemanagerctl:157 ERROR
[YYYY-MM-DDTHH:MM:SS] lifecycle: 3817790: imagemanagerctl:157 ERROR During handling of the above exception, another exception occurred:
[YYYY-MM-DDTHH:MM:SS] lifecycle: 3817790: imagemanagerctl:157 ERROR
[YYYY-MM-DDTHH:MM:SS] lifecycle: 3817790: imagemanagerctl:157 ERROR Traceback (most recent call last):
[YYYY-MM-DDTHH:MM:SS] lifecycle: 3817790: imagemanagerctl:157 ERROR File "/usr/lib/vmware/lifecycle/bin/imagemanagerctl.py", line 641, in software
[YYYY-MM-DDTHH:MM:SS] lifecycle: 3817790: imagemanagerctl:157 ERROR t.ApplyImage(swSpec, opts.depots, opts.taskId)
[YYYY-MM-DDTHH:MM:SS] lifecycle: 3817790: imagemanagerctl:157 ERROR File "/lib64/python3.8/site-packages/vmware/esximage/Transaction.py", line 1876, in ApplyImage
[YYYY-MM-DDTHH:MM:SS] lifecycle: 3817790: imagemanagerctl:157 ERROR res = NewTransaction.Transaction().PerformImageApply(newProfile,
[YYYY-MM-DDTHH:MM:SS] lifecycle: 3817790: imagemanagerctl:157 ERROR File "/tmp/esx-update-3817790/lib64/python3.8/site-packages/vmware/esximage/Transaction.py", line 1915, in PerformImageApply
[YYYY-MM-DDTHH:MM:SS] lifecycle: 3817790: imagemanagerctl:157 ERROR File "/tmp/esx-update-3817790/lib64/python3.8/site-packages/vmware/esximage/Transaction.py", line 1134, in _applyImageProfile
[YYYY-MM-DDTHH:MM:SS] lifecycle: 3817790: imagemanagerctl:157 ERROR File "/tmp/esx-update-3817790/lib64/python3.8/site-packages/vmware/esximage/Transaction.py", line 1266, in _validateAndInstallProfile
[YYYY-MM-DDTHH:MM:SS] lifecycle: 3817790: imagemanagerctl:157 ERROR File "/tmp/esx-update-3817790/lib64/python3.8/site-packages/vmware/esximage/ImageManager/HostSeeding.py", line 995, in __init__
[YYYY-MM-DDTHH:MM:SS] lifecycle: 3817790: imagemanagerctl:157 ERROR File "/tmp/esx-update-3817790/lib64/python3.8/site-packages/vmware/esximage/ImageManager/HostSeeding.py", line 1032, in _loadCachedVibs
[YYYY-MM-DDTHH:MM:SS] lifecycle: 3817790: imagemanagerctl:157 ERROR File "/tmp/esx-update-3817790/lib64/python3.8/site-packages/vmware/esximage/Utils/HostInfo.py", line 283, in GetVmfslFileSystems
[YYYY-MM-DDTHH:MM:SS] lifecycle: 3817790: imagemanagerctl:157 ERROR File "/tmp/esx-update-3817790/lib64/python3.8/site-packages/vmware/esximage/Utils/HostInfo.py", line 228, in _getFileSystemList
[YYYY-MM-DDTHH:MM:SS] lifecycle: 3817790: imagemanagerctl:157 ERROR esximage.Errors.InstallationError: Failed to query file system stats: Errors:
[YYYY-MM-DDTHH:MM:SS] lifecycle: 3817790: imagemanagerctl:157 ERROR Unable to complete Sysinfo operation. Please see the VMkernel log file for more details.: Vmkernel module necessary for this vsi call not loaded
[YYYY-MM-DDTHH:MM:SS] lifecycle: 3817790: imagemanagerctl:157 ERROR

 

 

Environment

vSphere ESXi 7.0 

Cause

Issue appears to be caused by nfsclient and nfs4client modules failing to load - vmkernel does not receive the vsi calls required to complete the update

Resolution

Please apply below steps to workaround the issue: 

 

1. Log into the ESXi through SSH/Putty as root

2. Run below commands: 

esxcli system module load --force --module nfsclient

esxcli system module load --force --module nfs41client

3. Now attempt the patch again - this should now go through successfully. 

 

Powered by Wolken Software