Aria Operations for Logs Node Intermittently goes to Disconnected State

Products

• VCF Operations/Automation (formerly VMware Aria Suite)

Issue/Introduction

• In the Aria Operations for Logs UI > Management > Cluster section, certain nodes intermittently enter a Disconnected state.
• Runtime logs indicate "Disk quota exceeded" during archival attempts, correlating with low available disk space on the /storage/core partition.
  
  /var/log/vmware/loginsight/runtime.log:

[2025-06-23 09:44:34.059+0000] ["ArchivingTasksHandler-thread-1"/##.##.##.## ERROR] [com.vmware.loginsight.repository.RepositoryWriter] [Failed to archive bucket ########-####-####-####-########]
java.io.IOException: Disk quota exceeded
        at java.io.FileDescriptor.close0(Native Method) ~[?:?]
        at java.io.FileDescriptor.close(Unknown Source) ~[?:?]
        at java.io.FileOutputStream$1.close(Unknown Source) ~[?:?]

[2025-06-23 09:46:40.258+0000] ["ArchivingTasksHandler-thread-1"/##.##.##.## ERROR] [com.vmware.loginsight.repository.RepositoryWriter] [Failed to archive bucket ########-####-####-####-########]
java.io.IOException: Disk quota exceeded
        at java.io.FileDescriptor.close0(Native Method) ~[?:?]
        at java.io.FileDescriptor.close(Unknown Source) ~[?:?]
        at java.io.FileOutputStream$1.close(Unknown Source) ~[?:?]
        at java.io.FileDescriptor.closeAll(Unknown Source) ~[?:?]

• Additionally, the system will send notifications regarding space issues and same can be noticed in the runtime log:
  
  [2025-06-14 19:36:54.208+0000] ["HealthCollectorScheduler-thread-1"/##.##.##.## INFO] [com.vmware.loginsight.notifications.AlertNotifier] [Sending alert notification for: Archiving Space Will Be Full]

Environment

Aria Operations for logs 

Cause

The issue arises from high disk space consumption, primarily due to failed NFS bucket archival attempts resulting from insufficient storage.

Resolution

To resolve this issue, increase the NFS storage capacity to ensure that archival tasks have enough space, thereby preventing disk space exhaustion and maintaining node connectivity.