VCLS VMs Inaccessible not able to deploy new VMs -A general system error occurred not well-formed (Invalid token)

Products

• VMware vCenter Server

Issue/Introduction

Customer VCLs Vms were in inaccessible state due to storage Issue where VCLS Vms were deployed 

Tried to deploy new VCLS Vms but its Failed with  below error

Environment

VMware vCenter Server 8.0 

Cause

•  VCLs Vms were in inaccessible state due to storage Issue where VCLS Vms were deployed 
• Also in Advance settings we can VCLS entries which is not getting modified to True ( refer below screenshot )

 

 

Resolution

• We need to remove old and wrong entry added in advance settings of the same cluster which is not possible from Advance setting of the VC UI.

Note :Please take the snapshot of the VC VM &  proper backup of vpxd.cfg file

• Stop vpxd service --- service-control --stop vmware-vpxd 

# sed '/<vcls>/,/<\/vcls>/d' -i /etc/vmware-vpx/vpxd.cfg

This will remove all retreat mode settings from all of the clusters in this vCenter, but it will allow vpxd to start again

• Start the VPXD service ----- service-control --start vmware-vpxd 
•  
• vCLS VMs should now automatically be deployed in the given cluster.(If not deployed we can deploy manually )

Additional Information

Putting the cluster in retreat mode - https://techdocs.broadcom.com/us/en/vmware-cis/vsphere/vsphere/7-0/vsphere-resource-management-7-0/creating-a-drs-cluster/vsphere-cluster-services-vcls/putting-a-cluster-in-retreat-mode.html.

Impact/Risks:

WiIl impact the Cluster services features and DRS would not work.