Persistent Disk Usage keeps growing on P-bosh Director

Products

• VMware Tanzu Application Service

Issue/Introduction

• After upgrade, the Bosh Director's persistent disk grows continually. 
• Implemented the CrowdStrike tile.
• At the moment it seem to be the /var/vcap/store/blobstore/store/ folders who's growing.
• Foundations using RabbitMQ broker tile see faster growth of the Persistent Disk on Bosh Director.
• Foundations with large numbers of deployment updates or rotations see faster growth of the Persistent Disk on Bosh Director.

Environment

Foundations with Crowdstrike tile versions equal to or LOWER than 1.9.0 present this issue.

Cause

This is caused by the Crowdstrike tile downloading its '.deb' installer package to /var/vcap/sys/log directory during installation. The .deb file is then gathered into the log_bundle by Bosh Director during deployment creation for each VM deployed. This .deb file is approx 74 MB in size, so if there are a large number of VM's or deployments created, the log_bundle gathered for each will contribute to a significant growth in the blobstore which backs the log_bundle database in Bosh Director Persistent Disk. 

Resolution

This will be fixed in Crowdstrike tile version 1.10.0+. See issue details in the Crowdstrike tile Github here.

 

To temporarily work around this issue by cleaning the Bosh Director Persistent Disk manually, use the following KB Article for reference.