Apply Changes failing with 'Task <abc-123> result: 1 of 20 pre-start scripts failed. Failed Jobs: cis."

Products

• VMware Tanzu Application Service

Issue/Introduction

A user performs an 'Apply Changes' from opsmanager UI and get error regarding 'cis' job:

Task <abc-123> result: 1 of 20 pre-start scripts failed. Failed Jobs: cis.

The 'cis' job logs show timeout errors.

'Auditd' process is consuming most resources on the VM. This can be verified by watching 'top' output while the issue is occurring.

Resolution

Temporary Workaround:

1. Increase the timeout for the Compliance Scanner job to allow it more time to complete successfully.

• To do this, adjust the job timeout settings in the configuration or adjust the service responsible for the timeout threshold.

This workaround allows the job to complete, but it may not address the underlying cause of the resource exhaustion issue.

 

Permanent Solution:

1. Increase the resources allocated to the VM to ensure it can properly accommodate the auditd process and any other high-resource jobs like the Compliance Scanner.

• Recommended steps:
  • Increase CPU and Memory: Allocate more CPU and memory to the VM where the issue is occurring.
  • Monitor Resource Usage: Use system monitoring tools (such as top or htop) to track resource consumption and adjust resources as needed.
  • By increasing the VM's resources, the system can handle the load imposed by the auditd process and the cis job, preventing timeouts during the Apply Changes process.

If the above does not resolve the issue, then can open a ticket with VMware's TANZU Support, by Broadcom.

Additional Information

The 'cis' job is part of Compliance Scanner for TANZU.