S3 bucket fails to load with timeout error in VMware Cloud Director

Products

• VMware Cloud Director

Issue/Introduction

When attempting to load larger buckets in the Object Storage Extension for VMware Cloud Director the UI will timeout. There are no specific errors in the logs, but significant performance issues are seen on the database for the Object Storage Extension.

Environment

VMware Cloud Director 10.6.x
Object Storage Extension 3.0.0.x

Cause

The bucket may have over 10 million objects which is not supported according to the VMware Cloud Director Object Storage Extension 3.1.0.3 Release Notes. The database for the Object Store Extension may also have a performance impact and require maintenance. The database is governed outside of Cloud Director and the Object Storage Extension itself and not directly supported for infrastructure issues.

Resolution

We can optimize the database. Object_info can be cleaned, and we can create a better view for objects. The statements are:

VACUUM (VERBOSE, ANALYZE) object_info;

and

CREATE INDEX CONCURRENTLY idx_object_info_optimal 
ON object_info (bucket_path, tenant_id, last_modified DESC)
WHERE version_deleted IS NULL OR version_deleted = false;