Error ""Request failed" "url":"/system/chjectcount", "status""500" when attempting to load Object Storage Extension buckets dashboard in VMware Cloud Director

Products

• VMware Cloud Director

Issue/Introduction

• Object Storage Extension(OSE) dashboards fails to load and following errors are observed:
  
  

• OSE is backed by Cloudian Hyperstore. The setup was previously functioning correctly, but the issue arose after the user expanded the Cloudian cluster by adding new nodes
• In /opt/vmware/voss/support/ose-default.log on the OSE server,  you see entries similar to:
  
  

  2025-03-06 00:03:38 [ForkJoinPool-1-worker-398] ERROR com.vmware.voss.job.TenantSyncJob - Failed to sync tenant usage for: #####-####-####-####-#######
  com.vmware.voss.error.RestClientException: {
  "servlet":"org.glassfish.jersey.servlet.ServletContainer-7b324505",
  "message":"Request failed.",
  "url":"/system/objectcount",
  "status":"500"
  }
          at com.vmware.voss.client.RestClientBase.exchange(RestClientBase.java:226)
          at com.vmware.voss.client.impl.CloudianAdminClient.getUserUsage(CloudianAdminClient.java:446)
          at com.vmware.voss.client.impl.CloudianAdminClient.getStorageTenantUsage(CloudianAdminClient.java:431)
          at jdk.internal.reflect.GeneratedMethodAccessor215.invoke(Unknown Source)
          at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
          at java.base/java.lang.reflect.Method.invoke(Method.java:569)
          at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:359)

• Executing the following Cloudian API manually also resulted in a '500 Request failed' error:    curl -X GET -k -u sysadmin:<password> 'https://cloudian-URL:19443/system/objectcount?groupId=<tenant-id>&userId=*'

       Note: Replace '<password>' with Cloudian sysadmin password and '<tenant-id>' OSE tenant Id.

Environment

VMware Cloud Director 10.x
Object Storage Extension 3.x

Cause

Cloudian API is responsible for populating the OSE dashboard by capturing and loading the usage data. This issue arises when the Cloudian API fails to provide the object count to OSE.

Resolution

To resolve this issue, it is advised to involve Cloudian support. In this scenario, Cloudian support executed following API to repair the storage usage data for group or system:

POST /usage/repair?groupId=string[&summarizeCountsOnly=bool] [&region=string]

Note: Please engage Cloudian support for guidance on executing this API or troubleshooting any errors that may occur during its execution.