Sending reports to a network share is failing after some time
Article ID: 380828
Updated On:
Products
Issue/Introduction
After setting up a Network Share to send reports from Aria Operations, it may work for some time then start to fail.
You confirm that the share location is able to be mounted on the Aria Operations node using a command similar to:mount -t cifs //target/folder /mnt/test
You are able to confirm that the network share location is using SMB 2.1
When looking at the analytics logs, you may see the following errors:
2024-10-25T15:30:35,887+0000 ERROR [pool-27-thread-1] com.vmware.vcops.uploadplugins.cifs.CifsPlugin.internalUpload - Failed to upload file: /tmp/10-25-24 081036_000934 <file_name>.pdfcom.hierynomus.smbj.common.SMBRuntimeException: com.hierynomus.protocol.transport.TransportException: java.util.concurrent.ExecutionException: com.hierynomus.smbj.common.SMBRuntimeException: com.hierynomus.protocol.transport.TransportException: com.hierynomus.protocol.commons.buffer.Buffer$BufferException: Underflow
2024-10-25T15:31:35,909+0000 ERROR [pool-27-thread-1] com.vmware.vcops.uploadplugins.cifs.CifsPlugin.internalUpload - Failed to upload file: /tmp/10-25-24 081036_000934 <file_name>.csvcom.hierynomus.smbj.common.SMBRuntimeException: com.hierynomus.protocol.transport.TransportException: java.util.concurrent.ExecutionException: com.hierynomus.smbj.common.SMBRuntimeException: java.util.concurrent.TimeoutException: Timeout expired
2024-10-25T15:32:35,918+0000 WARN [pool-27-thread-1] com.vmware.vcops.uploadplugins.cifs.CifsPlugin.internalUpload - Exception while closing SMB session: 444202831840129com.hierynomus.protocol.transport.TransportException: java.util.concurrent.ExecutionException: com.hierynomus.smbj.common.SMBRuntimeException: java.util.concurrent.TimeoutException: Timeout expired
Environment
Aria Operations 8.12.1
Cause
Too many requests to send the report to the network share may be happening at once. After some time, Aria Operations is not able to close the SMB connections and the queue becomes full. For example, you may be sending hundreds of reports at once to the network share file server. The queue can backup and prevent any more reports from sending to the designated file server location.
Resolution
- A cluster restart will be needed to clear the queue. Follow Shutdown and Startup sequence for Aria Operations cluster to safely restart the cluster.
- Adjust the report schedule so that only a few reports get sent every few minutes, such as 15 reports every 15 minutes or so.
Feedback
