Downloading usage data from vCloud Usage Meter 4.4 fails with an internal server error

Products

• VMware Aria Suite

Issue/Introduction

Symptoms:
When trying to download usage data from a Usage Meter 4.4 appliance, the download fails with an internal server error. The following error appears in the Usage Meter nginx log files: /opt/vmware/cloudusagemetering/var/nginx/logs/.
 

2021/11/01 05:13:26 [crit] 5267#0: *110892 open() "../umdata/NSX-T_Collection/2021/10/02/1870-1633163704026.zip" failed (24: Too many open files), client: XXX.XXX.X.XXX, server: localhost, request: "GET /api/v1/usage-data/2021-09?sessionid=UmSIDT60JlhznY/jod9iVPZp5zRsxjSNYL6sm37v2BlKVB38 HTTP/1.1", host: "XX.XX.XXX.XX", referrer: "https://XX.XX.XXX.XX/usage"

Environment

VMware vCloud Usage Meter 4.x

Cause

The failed download is due to the nginx worker max open files limit that prevents the download from completing.

Resolution

Procedure

To fix this issue, do the following:

1. Log in to Usage Meter console as root.
2. Get the nginx worker pid by entering the following command:

ps aux | grep nginx

3. Check if the current max open files limit is set to 4096.​

Note: Substitute the pid with the id from the previous command.

cat /proc/$pid/limits | grep “Max open files"

4. Increase the max open files limit to e.g. 20480.

Note: Substitute the pid with your nginx worker id.

prlimit --nofile=20480:20480 --pid $pid