Generating a log bundle in Aria Automation produces an error stating "Not enough disk space".

Products

• VCF Operations/Automation (formerly VMware Aria Suite)

Issue/Introduction

When generating a log bundle of Aria Automation on the appliance itself, one of these errors can be observed:

• [ERROR] Will try to collect a smaller bundle by limiting the collected files: Not enough space on disk.
• [ERROR] Failed to build bundle contents for noop pod [command-executor-####] due to an error: Subprocess completed with an unexpected exit code on noop pod [command-executor-####]: [1]. Stderr: [Not enough space on disk. At least 2GB required, 551MB left on disk.
• [ERROR] Failed to assemble log bundle log-bundle-########.tar. Exception: [<class 'subprocess.CalledProcessError'> - Command '['/usr/bin/bash', '/opt/scripts/merge_log_bundle_parts.sh', '--source', '/home/root/.log-bundle-###########', '--output', '/home/root/log-bundle-########.tar']' returned non-zero exit status 1.].
• [ERROR] assembly script stderr> Failed to handle bundle component local-node-logs.tar, skipping it: <class 'OSError'>: [Errno 28] No space left on device. Assembled bundle will be incomplete.
• [ERROR] assembly script stderr> An exception interrupted the bundle assembly: <class 'OSError'>: [Errno 28] No space left on device. The assembled bundle might be incomplete
####-##-## ##:##:##,### [ERROR] An error occurred while generating bundle /home/root/log-bundle-#######.tar: KXKXKXKX or more subtasks have finished with errors.]. Generated bundle might be missing or incomplete. Check the logs above for additional info

A log bundle may still be generated, however it will be missing relevant files needed for troubleshooting issues such as an entire node's logs.

In a similar context of low disk space, log bundles generated by Aria Lifecycle Manager may also be very small (sometimes around 2MB) and missing the relevant logs.

Usually, for a production environment (3-node cluster), a reasonable log bundle size will be from hundreds of MB to several GB in size.

Environment

• VMware Aria Automation 8.x
• VMware Aria Suite Lifecycle 8.x

Cause

This can be caused by exisitng/old log bundles present in the /home/root directory of an Aria Automation appliance node, taking up the space required to generate a complete log bundle.

Resolution

Delete older log bundles either directly from the Aria Automation appliance, or from Aria Lifecycle Manager, and then generate a new log bundle.

From the appliance:

Open a SSH session to the Aria Automation appliance, and delete old log bundles under the /home/root directory.

Once the old log bundles are deleted, a new log bundle can be generated directly from the Aria Automation appliance with the command: vracli log-bundle.

From Aria LCM:

In the Aria Lifecycle Manager UI, navigate to Lifecycle Operations > Environments > click the elipses menu of the Aria Automation tile > Logs > Delete Logs.

Then, following the same menu path, select Generate Logs.