ESXi upgrade fails at ESX UPGRADE VUM STAGE POSTCHECK with unknown error in SDDC Manager
search cancel

ESXi upgrade fails at ESX UPGRADE VUM STAGE POSTCHECK with unknown error in SDDC Manager

book

Article ID: 313213

calendar_today

Updated On:

Products

VMware Cloud Foundation

Issue/Introduction

Symptoms:

  • ESXi upgrade fails at the ESX UPGRADE VUM STAGE POSTCHECK stage in SDDC Manager.

  • Following snippets are observed in the /var/log/vmware/vcf/lcm/lcm-debug.log file:

 

YYYY-MM-DDTHH:MM:SS.932-0600 ERROR [vcf_lcm,67ef0495dddfd9a144011b107e3e1f2d,20d6] [c.v.evo.sddc.lcm.model.task.SubTask,http-nio-127.0.0.1-7400-exec-2] Upgrade error occurred:
The ESXi update postcheck failed with an unknown error.
Reference token <token_id>

 

YYYY-MM-DDTHH:MM:SS.473-0600 INFO  [vcf_lcm,67ef04b38baa193083f2d71e0b2d930c,b083] [c.v.e.sddc.lcm.audit.AuditScheduler,vac-scheduler-1] Last upgrade status for software type ESX_HOST and resourceId <host-id> is: {"id":"XXX","bundleId":"7a70a555-74ec-4849-89d4-3e45b551c8d8","bundleElementId":"435b7342-9ec6-4692-8ca8-dcc396633313","bundleElementOrder":1,"resourceType":"ESX_HOST","resourceId":"<host-id>","upgradeId":"0c99f3b1-1aff-4b5c-b9c5-c24355906372","upgradeStatus":"COMPLETED_WITH_FAILURE","upgradeError":

 

{"errorType":"RECOVERABLE","stage":"ESX_UPGRADE_VUM_STAGE_POSTCHECK","errorCode":"ESX_UPGRADE_VUM_POSTCHECK_FAILED_UNKNOWN_ERROR","errorDescription":"\nThe ESXi update postcheck failed with an unknown error.","errorDescriptionCodes":["ESX_UPGRADE_VUM_POSTCHECK_FAILED_UNKNOWN_ERROR"],"errorDescriptionAttributes":{"0":"Existing SSH key not found for host <host-fqdn>"},"metadata":"\nManual intervention needed as upgrade failed during install stage.\nCheck for errors in the lcm log files located on SDDC Manager under /var/log/vmware/vcf/lcm.\n Please retry the upgrade once the upgrade is available again."

 

Environment

VCF 4.5.x

Cause

During the host commission process (in VCF), the host DNS name gets normalized to lowercase while persisting the information.

Resolution

This issue is resolved in VCF 5.x.

To resolve the issue on on releases prior to VCF5.x, please follow the steps below:

  1. Replace the problematic hostname(s) in the known_hosts files at the locations below with the hostname(s) in lower case:

/root/.ssh/known_hosts
/home/vcf/.ssh/known_hosts
/etc/vmware/vcf/commonsvcs/known_hosts

  1. Restart all SDDC Manager services by running following command. 

        /opt/vmware/vcf/operationsmanager/scripts/cli/sddcmanager_restart_services.sh


Post making the above changes, try to perform upgrade.