Aria Operations (8.x) Cluster goes offline intermittently with Error 'FORWARD_DATA_REGION region exceed the maximum number (20000) of entries'

Products

• VMware Aria Operations 8.x
• VCF Operations/Automation (formerly VMware Aria Suite)

Issue/Introduction

• Aria Operations Cluster goes offline  intermittently with Error 'FORWARD_DATA_REGION region exceed the maximum number (20000) of entries'
• Analytics process crashes on primary node every ~6 hours 
• analytics-wrapper.log located in /data/vcops/log contains entries similar to those mentioned below:

2025-01-13T01:09:16,661+0000 ERROR [itask-thread-fsdb-data-retention-manager] com.vmware.vcops.fsdb.FsdbDataRetentionManager.deleteResourceData - Delete resource data request is failed for resource 679658 :com.integrien.alive.FSDB.CorruptedFileException: The file /usr/lib/vmware-vcops/data/6xx/679xx/152xxx_03_xxxxx.dat was corrupted loadHeader: Header version mismatch 0 != 2 and failed to repair No any data could be repaired, the file '/usr/lib/vmware-vcops/data/6xx/679xx/152xxx_03_xxxx.dat' was deleted.

Environment

VMware Aria Operations 8.x

Cause

Due to environmental issues such as NTP or diskspace, the date format of the FSDB .dat file can become corrupted. This causes the FSDB file(s) to contain a date that is unrealistic and futuristic.

Resolution

This issue involves Database modifications, submit a Support Request with Broadcom Support for further assistance.