Portal url is continuously refreshing and cloud cells showing Inactive in VMware Cloud Director

Products

• VMware Cloud Director

Issue/Introduction

• The VMware Cloud Director user interface does not fully load or is only intermittently available.
• If the interface loads, one or more cells are listed as Inactive.
• In /opt/vmware/vcloud-director/logs/cell.log, an error similar to the following is seen:
  
  ...out of space
    log4j:ERROR Failed to flush writer
    java.io.IOException: No space left on device
  
  
• When examining the available space on the root partition (/), there does appear to be adequate space.
• A recent multi-cell log bundle was initiated, as in the following:
  
  Collecting diagnostic information for VMware Cloud Director
  
  
• During the startup of the VMware Cloud Director service, there is a point where the space on the root partition is rapidly consumed until it reaches 100% utilization.
• During the startup of the VMware Cloud Director service, items are collected in the following directory:
  
  /opt/vmware/vcloud-director/tmp/log-collector/

Environment

VMware Cloud Director 10.6.x

Cause

The root partition (/) ran out of space during the multi-cell log bundle collection and continues to run out of space during service startup as it attempts to fulfill the initial log bundle request.

Resolution

In order to remediate this issue, perform the following steps:

1. Initiate a command line session to one of the VMware Cloud Director (VCD) cells either via SSH or console.
2. Execute the following command to clear the existing bundle attempt:
   
   /opt/vmware/vcloud-director/bin/vmware-vcd-support -c
   
   
3. Stop and start the VCD service on all impacted cells:
   
   Steps to stop, start, or restart the VMware Cloud Director service before rebooting the nodes

Additional Information

For more information about freeing space on a VMware Cloud Director cell, please refer to the following:

Log files consuming excess amount of storage space in VMware Cloud Director 10.5 and 10.6

Error: "Job for vmware-vcd.service failed because the control process exited with error code" when you are trying to start VMware Cloud Director services