VMware Cloud Foundation: SDDC Manager Backups continually failed with "OSError: [Errno 24] Too many open files"

Products

• VMware Cloud Foundation

Issue/Introduction

Symptoms:

SDDC Manager Backup fails with the error: "Too many open files".

 

Environment

VMware Cloud Foundation 4.4.1
Vmware Cloud Foundation 4.5.1

VCF 9.0.2.0

Cause

Every SDDC Manager backup operation was leaving a few open file handles and after a few months the file system was full due to those open file handles. This issue is noticed when the SDDC Manager backups are scheduled with an hourly frequency.

Resolution

Workaround:

To workaround the issue, restart the 'sosrest' service.

1. SSH into SDDC-Manager as a root user.
2. Run "systemctl restart sosrest".