[9.1.1] VCF management services volume disk usage approaching capacity

Products

• VCF Operations

Issue/Introduction

The following alert appears in VCF Operations:

• VCF Management Services Volume Disk Usage Approaching Capacity
  
  
• The storage volume allocated to a particular VCF management services component is nearing its capacity due to the accumulated size of the components data (e.g., retained logs, historical metrics, binaries, etc.). If the volume reaches capacity, it could impact the functionality of the component.
  
  
  

Environment

• VCF Operations 9.1.1
• VCF Services Runtime 9.1.1

Cause

Storage volumes allocated to VCF management services components accumulate data over time.

When a volume is full, the component that owns it cannot write new data. The specific operational impact depends on which volume is affected. Refer to the Impact Assessment Table in the Additional Information section below.

Resolution

The storage volume might have been under provisioned when the component is deployed in which case increasing it's size might help.

If expansion has been performed more than once on the same volume within a short period and the alert continues to recur. This pattern indicates a component storage issue that requires further investigation before increasing its size. 

1. Navigate to VCF management components page (Build > Lifecycle > Components) and select the component that is using the storage volume.
2. From the Actions menu, select Increase Storage Size.
3. Specify the new volume size and click Apply.
4. Monitor the task progress in Build > Lifecycle > Tasks.

 

 

 

Additional Information

• Impact 
  Navigate to VCF management services health dashboard (Operate > VCF Health > Component View > VCF Management Services) to identify the VCF management services component that is using the storage volume and its utilization

 

Impact Assessment Table

Volume Group	Component	Volume Description	Impact if not resolved
pgdata-vidb-postgres-instance-2	Identity Broker	Identity broker database storage	SSO and login operations might fail
pgdata-vcf-sddc-lcm-db-0	SDDC Lifecycle	SDDC lifecycle management database	Lifecycle operations (install, upgrade, configure) might fail
pgdata-vcf-fleet-lcm-db-2	Fleet Lifecycle	Fleet lifecycle management database	Fleet lifecycle operations (install, upgrade, configure) might fail
pgdata-pgdatabase-0	Salt RaaS	SaltStack RaaS database storage	Configuration management operations might fail
salt-master-volume	Salt Master	SaltStack master data storage	Configuration distribution to managed nodes might fail
depotservice-data-pvc	Software Depot	Software bundle storage	Software bundle downloads for installs and upgrade might fail
distributionservice-data-pvc	Software Depot	Software distribution staging storage	Software distribution operations for fleet component might fail
Logging Buffer	VCF services runtime	Temporary storage for log buffering	Logs are not forwarded to VCF Operations
Metrics Database	VCF services runtime	Temporary storage for component metrics	Metrics might not be forwarded to VCF Operations
Support Bundles	VCF services runtime	Storage for generated support bundles	Support bundle generation might fail
Application Registry	VCF services runtime	Storage for application images and charts	Application image pulls and chart deployments might fail
Shared Storage	VCF services runtime	Shared storage used by all components	Multiple component write operations may might fail