/storage/db partition is nearly full due to the huge size of the stellar.db file

Products

• VMware vCenter Server

Issue/Introduction

• /storage/db partition on vCenter Server is almost full. 
• Running df -h, you see entries similar to:
  

  /dev/mapper/db_vg-db                      9.8G  7.4G  2.0G  80% /storage/db

• Running du -aSh /storage/db | sort -rh shows that stellar.db is the largest file in /storage/db:  
  

  # du -aSh /storage/db | sort -rh
  4.2G    /storage/db/stellar.db
  4.2G    /storage/db

Environment

vCenter Server 7.x

Cause

Broadcom is aware of this issue, but the root cause has yet to be determined.

Resolution

Workaround:

1. Log into the vCenter Server Appliance as root via SSH or the vCenter virtual machine Console.
2. Open Sqlite db:
   sqlite3 /storage/db/stellar.db

3. Clean up observalues table
   delete from observervalues where metricname ="FDSize";
4. Exit the target database using the following command:
   .quit
5. Restart observability service using below command:
   service-control --restart observability OR systemctl restart observability

Additional Information

Troubleshooting VCHA failover failed due to large amount of stellar.db files