vCenter upgrade in VCF 5.1.x fails at stage SET_DRS_AUTOMATION_LEVEL_TO_MANUAL_FAILED
search cancel

vCenter upgrade in VCF 5.1.x fails at stage SET_DRS_AUTOMATION_LEVEL_TO_MANUAL_FAILED

book

Article ID: 314655

calendar_today

Updated On:

Products

VMware Cloud Foundation

Issue/Introduction

Symptoms:

In /var/log/vmware/vcf/lcm/lcm-debug.log, we see error messages such as:

UpgradeError, stage: VCENTER_UPGRADE_SET_DRS_MANUAL, errorType: RECOVERABLE,errorCode: SET_DRS_AUTOMATION_LEVEL_TO_MANUAL_FAILED, errorDescription: com.vmware.vcf.error.update.set.drs.automation.level.to.manual.failed, remediateSteps: Please use the DRS trouble shooting information link for further details: https://pubs.vmware.com/vsphere-65/index.jsp#com.vmware.vsphere.resmgmt.doc/GUID-5E7F6DEC-02A2-4221-AABA-EDFB9AE9EC70.html

 

Upgrade error occurred: Reason is: com.vmware.vcf.error.update.set.drs.automation.level.to.manual.failed


Environment

VMware Cloud Foundation 5.1.1
Vmware Cloud Foundation 5.1

Cause

The property collector response is truncated to 100 objects/entries while the actual response would have been expected to yield all the objects (with several VMs managed by the vCenter Server).
If the required vCenter Server VM is absent in the truncated response, SDDC Manager is unable to find the vCenter VM, causing the upgrade to be marked as a failure.

Resolution

This behavior will be resolved in future VCF releases.


Workaround:

Note: Take Backup of vpxd.cfg file on the vCenter Server.
This workaround is only required on the Management Domain vCenter to cover both Management and WLD vCenter Upgrades. 


Run through the following steps:

1. Log in as root through an SSH or console session on the vCenter Server Appliance.
2. Enable the bash shell:

shell.set --enabled true

3. Set and override the object limit policy for property collector in the vCenter in the file: /etc/vmware-vpx/vpxd.cfg file:

<config>
   <propertyCollector>
     <maxObjectsLimit>1000</maxObjectsLimit>
   </propertyCollector>
</config>

4. Restart the vpxd service

service-control --stop vmware-vpxd
service-control --start vmware-vpxd

5. Ensure the vpxd service starts successfully:

service-control --status vmware-vpxd