ESXi host health check fails during upgrade to VCF 9.1

Products

• VMware Cloud Foundation

Issue/Introduction

• When initiating the ESXi host upgrade from VCF Operations, the task fails with error "Health Check for <ESXi host FQDN> failed." 
• In /var/log/vmware/vmware-updatemgr/vum-server/vmware-vum-server.log, below error message is observed:
  
  "errorMessageId":"com. vmware.vcIntegrity. lifecycle.health.internal.external_provider.provider_fault", "errorMessage":"'vSphere ESX Agent Manager' service, running on 'host '<ESXi host FQDN>'', reported issue: System VM <vm-id> on host HostSystem:<host-id> required by Agent <agent-ID> is not ready."
  
  
• The Malware Prevention Service virtual machine(VMware_MPS-SVM-<version>) is present on the affected ESXi host but in powered-off state.

Environment

VMware Cloud Foundation 9.1

Cause

The NSX Malware Prevention Service VM on the affected host is powered off, which causes the vCenter Lifecycle Manager (vLCM) health check to fail.

Resolution

Power on the Malware Prevention Service virtual machine to allow the health check to pass:

1. Login to vCenter Server.
2. Locate the affected ESXi host.
3. Manually power on the VMware_MPS-SVM-<version> virtual machine.
4. Re-initiate the ESXi upgrade task from VCF Operations.