VCLS VM deployment fails due to EAM service Down

Products

• VMware vCenter Server

Issue/Introduction

• DRS functionality was impacted in one or more clusters. The vCenter UI displayed the following warning:
  
  "vSphere DRS functionality was impacted due to unhealthy state vSphere Cluster services caused by the unavailability of vSphere Cluster Service VMs."
  
  
• It is also observed that vSphere Cluster Service (VCLS) VMs not deploying in the clusters.
  
  
• EAM service down as the /storage/log full 
  
  
• Upon investigation the folder /var/log/vmware/wcp is found to be either one of or the largest folder on the /storage/log partition

• Upon running command  du -hs * | sort -rh | head -5  in /var/log/vmware/wcp directory , the 

  8.9G   stdstream. log-3.stderr
  2.9G   stdstream. log-0.stderr
  2.5G   stdstream. log-4.stderr
  2.0G   stdstream. log-2.stderr
  8.3M   wcp-audit.log

Cause

The EAM service is responsible for deploying VCLS VMs. When the log partition is full, EAM service  may fail to start, resulting in VCLS deployment failures and impacted DRS operations.

Resolution

To mitigate this problem need to remove/delete the old files

• Take a snapshot of the vCenter Server appliance before performing cleanup.
  
  
• Remove the large .stderr log files from the /var/log/vmware/wcp/ directory. For more information refer Log Disk Exhaustion caused by wcp stdstream.log
  
  
• Start the EAM service using the following command:
  
  service-control --start eam
  
  

Additional Information

See also: 

• /storage/log partition full due to large stream.log-x.stderr files
  
  
• vCenter Server Appliance disk space is full