Add disks to a node in Aria Operations cluster

Products

VMware Aria Suite

Issue/Introduction

Each cluster node has a Logical Volume that grows over time, potentially requiring additional disk space.

Note: If this article does not resolve your issue, see Troubleshooting Storage Issues in Aria Operations.

You may experience one or more of the following symptoms:

The Aria Operations Product UI login page displays the message:

Data Retriever is not initialized yet. Please wait...

The Aria Operations Product UI cluster is in an offline state
The Aria Operations Product UI is inaccessible
The Admin UI displays a message under the Cluster Status stating:

Cluster was shut down because one or more nodes were out of disk space.

The Admin UI shows one or more nodes in status under the Cluster Status :

Waiting for analytics
The analytics service is not starting on the Aria Operations node.
The oldest historical metric data is missing for multiple objects.
Metric collections have stopped and only current metric data is visible for multiple objects; current metric data is not saved.
The /storage/db logical volume on one or more Analytic node is close to or greater than 90% usage.
The web interface is still unavailable 1 hour after rebooting the Aria Operations appliance.
Generating out of the box reports in the Product UI is generating with - entries or report generation is failing with Error
You might also receive the alert "FSDB is running critically low on disk space" on Aria Operations analytics nodes.
Users are not able to sign into the product UI
Upgrade fails with error "Operation fails. If the error persists, contact VMware support" where the storage/db is nearly full and the issue does not match the kb Upgrade fails with error: Operation Failed. If the error persists, contact Broadcom Support

Environment

Aria Operations 8.12.x and later

Resolution

In most cases, the Aria Operations cluster has automatically been taken offline. If the cluster is not offline, log into the Admin UI as admin and click the Take Offline button to take the cluster offline.
Do not proceed unless the cluster is offline.

Note: All analytic nodes must have the same amount of space in the /storage/db logical volume.

If you are adding additional storage to a new deployment please add the storage after power on and configuring cluster

Only perform the following steps on Analytic nodes (Primary, Primary Replica, Data):

Ensure the Aria Operations cluster is Offline, then log into the VMware vSphere client as an administrator.
Right-click the desired Aria Operations node and click Power > Shut Down Guest OS.
Right-click the powered off node and click Edit Settings.
Click the Hardware tab and click Add.

Note: Do NOT expand an existing disk.

Click Hard Disk and click Next.
Select Create a new virtual disk and click Next.
Set Disk Size to an appropriate value.

Note: Do not go above 2TB for a single disk.

Disks larger than 2TB do not increase the /storage/db volume in Aria Operations for more info.

Select a disk provisioning format, if applicable.

Note: When possible, select the Thick Provision Eager Zeroed option.

Select a location to store the disk and click Next.
Accept the default Virtual Device Node and click Next.
Review the information and click Finish.
Click OK. The new storage is now added to the node.
Right-click the node and click Power On.
Repeats steps 1-13 on all other analytic nodes.

Note: All analytic nodes must have the same amount of space in the /storage/db logical volume.

Log into the Admin UI as admin and click the Bring Online button to bring the cluster online.

The node discovers the additional storage and adds it to the /storage/db logical volume automatically during boot.

Additional Information

For more information about sizing the Aria Operations cluster:

VMware Aria Operations Sizing Guidelines