Under certain operational conditions such as a customer-managed certificate rotation or out-of-band credential updates, virtual machines across the foundation may become unresponsive or experience system-level failures (such as NATS messaging bus outages). This issue typically manifests when the local disk space on affected VMs becomes completely exhausted due to accumulating quarantined files.
Product: VMware Tanzu Application Service / Anti-Virus for VMware Tanzu
Infrastructure: VMware Tanzu Operations Manager
Product Release: 2402.8.20.1 (or other supported versions using the Anti-Virus tile)
Configuration: ClamAV / Anti-Virus tile configured with the "Move" action for detected or flagged files
The issue is caused by a quarantine loop where the Anti-Virus scanner continuously flags and moves files into its designated quarantine directory (/var/vcap/data/antivirus/found).
When manual or customer-managed certificate updates are performed out-of-band, the scanner identifies these unknown file changes as potential threats. Because the tile is configured with the action set to Move, flagged files are moved into the quarantine directory. If this destination folder is not excluded from ongoing scans, the system repeatedly scans and moves files into the quarantine directory until the ephemeral disk (/var/vcap/data) reaches 100% utilization.
Clean up ephemeral disk space on affected VMs
SSH into any unresponsive or impacted VMs.
Check disk usage to confirm space exhaustion:
df -h /var/vcap/dataClear the accumulated files in the quarantine folder to recover disk space:
rm -rf /var/vcap/data/antivirus/found/*
Verify and restart failing services:
monit summary
monit restart all
Configure directory whitelisting
In Ops Manager, open the Anti-Virus for VMware Tanzu tile.
Navigate to Anti-Virus Configuration.
In the field designated for ignored directories/files, add the full path to your customer-managed certificate directory (e.g., /var/vcap/jobs/custom-certs/config/).
Update Detection Action
In the Anti-Virus tile configuration, locate Action to take when a virus is found.
Change the action setting from Move to Notify.
Note: Changing to Notify logs alerts to syslog without moving files, preventing unexpected disk exhaustion.
Coordinate scans during maintenance
Prior to performing future manual certificate rotations or major configuration changes, temporarily disable scheduled scans (set Interval for scheduled scans to Disabled).
Perform the maintenance task, then re-enable the scan schedule.
Apply Changes
Return to the Ops Manager Installation Dashboard.
Click Apply Changes to re-deploy the updated configuration across all foundation VMs.
Refer to the official product documentation: Installing and Configuring Anti-Virus for VMware Tanzu.