VCF Operations for Logs in a failed state

Products

• VCF Operations

Issue/Introduction

VCF Operations for Logs instance in a failed state, resulting in the web gui not displaying.

Running 'df -h' shows root partition being full

Environment

VMware Aria Operations for Logs 9.x

Cause

The file /var/log/maillog is the default location for storing mail messages sent to the root user on Unix-like systems, such as Linux. This is typically the system mail file, where notifications, alerts, or error messages related to system operations, such as cron jobs or system processes, are sent to the root user.

Resolution

Workaround:

1. Create a snapshot without memory on all nodes in the Aria Operations for Logs cluster
2. SSH to the primary node using root credentials
3. Stop the Aria Operations for Logs service with the below command
    service loginsight stop
4. Run the below command to clear the content of the maillog file
   truncate -s 0 /var/log/maillog
5. Reboot the node to ensure that the used space is cleared out
6. Repeat steps 2-5 on all remaining nodes in the cluster