Aria Operations displays the critical alert: FSDB file corruption detected

Products

• VMware Aria Suite

Issue/Introduction

• Aria Operations displays the critical alert:
  
  FSDB file corruption detected
  
  
• The /storage/log/vcops/log/analytics-<UUID>.log file contains entries similar to:

2015-06-02 22:59:14,987 ERROR [Data Retriever worker thread 13947 ] com.integrien.alive.FSDB.FSDBAccessor.onFsdbException - FSDB throws an exception: CorruptedFileException: The file /usr/lib/vmware-vcops/data/7/7812/2015_06_7812.dat was corrupted DataBlock CRC Failure in file for Resource 7812, filename = /usr/lib/vmware-vcops/data/7/7812/2015_06_7812.dat and repaired successfully.

Note: The preceding log excerpts are only examples. Date, time, and environmental variables may vary depending on your environment.

Environment

Aria Operations 8.x

Cause

This issue can occur when:

• The virtual machine or system stops abruptly.
• The disk does not have time to complete a task.
• There are bad blocks on disk.

Resolution

This is an expected behavior in VMware Aria Operations when there is FSDB corruption due to issues mentioned in the Cause section.

 

1. Make a note of the resource or file name within the alert.
2. Delete the alert(s) from Aria Operations.
3. If the alert(s) returns and references the same resources or files noted from step 1
   1. Take the cluster offline and take snapshots as per How to take a Snapshot of VMware Aria Operations
   2. Bring the cluster back online and open the Aria Operations UI again.
   3. Browse to Operations >> Configurations >> Inventory Management
   4. Using the Show Columns button at the bottom of the page, make sure that "Internal ID" is selected.
   5. Use the filter to search for the ID's mentioned in the alert.
   6. The historical data retained in FSDB for these objects has been corrupted and needs to be deleted, select the object and use the delete button to remove the historical data for the object in question.
   7. The object will be recreated and start collection again during the next collection cycle.

Additional Information