Error: "Error during enter MAINTENANCE check due to InsufficientResourcesFault" after precheck failure during "ENTER MAINTENANCE DRYRUN CHECK"

Products

• VMware Cloud Foundation

Issue/Introduction

• Similar error in lcm.log:

ERROR [0000000000000000,0000,precheckId=########-####-####-####-############,resourceType=NSX,resourceId=########-####-####-####-############] [c.v.e.s.l.c.v.vsphere.VsphereUtils,pool-2-thread-449] Error during enter MAINTENANCE check due to InsufficientResourcesFault { "_msg": "Insufficient resources.", "_faultMsg": [ { "key": "com.vmware.cdrs.maintenancemode.clusterLoadViolated", "arg": [ { "key": "threshold", "value": 80 }, { "key": "clustload", "value": 92 }, { "key": "resource", "value": "memory" } ], "message": "Host cannot enter maintenance mode since the resulting cluster memory load (92%) exceeds the tolerence threshold (80%)." } ], "stackTrace": [], "suppressedExceptions": [] }

• Similar message:

Error description: the virtual machine is pinned to a host: Insufficient resources.
Impact: High: Do not perform upgrade without addressing this issue.
Remediation: This category is for errors that were not due to general exceptions. Check for errors in error object, check LCM logs –InsuffcientResourceFault: Check the HA settings in the VC UI. See if the error is due to HA configuration KB: https://kb.vmware.com/s/article/2005073 Or This issue occurs when the CPU resource reservations of the virtual machine exceed the available capacity on the target host. 

 

Environment

VCF: 3.10.x, 4.x

Resolution

Suppress the dry run EMM flags

1. Add the following lines to the end of /opt/vmware/vcf/lcm/lcm-app/conf/application-prod.properties:
   lcm.nsxt.suppress.dry.run.emm.check=true
lcm.esx.suppress.dry.run.emm.check.failures=true
2. Restart the lcm service
   systemctl restart lcm

Workaround:

Cluster utilization can be verified from VC as below:

1. Log into vCenter
2. Navigate to the cluster under Hosts and Clusters
3. Under TheMonitor tab, click on vSphere DRS
4. Verify the CPU Utilization.
5. Verify the Memory Utilization.

Reeduce the utilization and then retry the precheck.:

1. Shut down VMs that are not critical for  operation during upgrade. This will reduce memory/CPU requirement on cluster.
2. Disable HA and HA Admission Control this will remove memory constraints.
   
   
   
   

Additional Information

Also see: Error: "VM faults in EMM dry run" after precheck fail on hosts with Zerto VMs