Usage Meter fails to upload consumption data

Products

• VMware Usage Meter

Issue/Introduction

The following exceptions are observed in Usage Meter logs.

dss_main.log:

c.v.um.common.platform.JournalClient with Socket Timeout Exception:

YYYY-MM-DD 09:32:15.061 ERROR --- [pool-2-thread-1] c.v.um.common.platform.JournalClient : Read timed out
java.net.SocketTimeoutException: Read timed out
at java.base/sun.nio.ch.NioSocketImpl.timedRead(Unknown Source)

vmware-um-journal.log:

The following OutOfMemoryError is outputed periodically:

Mon Day 08:40:46 ck2tky4-vvopum11 start-journal-service.sh[1634]: YYYY-MM-DDT08:40:46.573Z ERROR 1634 --- [VCF
Usage Meter Journal Service] [0.1-8051-exec-4] o.a.c.c.C.[.[.[/].[dispatcherServlet] : Servlet.service() for servlet
[dispatcherServlet] in context with path [] threw exception [Handler dispatch failed: java.lang.OutOfMemoryError: Java
heap space] with root cause
Mon Day 08:40:46 ck2tky4-vvopum11 start-journal-service.sh[1634]: java.lang.OutOfMemoryError: Java heap space

 

Environment

VMware Usage Meter 9.0.x

Cause

Due to a large number of journal notification messages that are accumulated, Journal Service in Usage Meter detects lack of Java heap memory as exception and it also generates exception at JournalClient, finally stops to load consumption data.

 

Resolution

1. Login to Usage Meter appliance as usagemeter user account by SSH and open the following file by vi editor:

   # vi /opt/vmware/cloudusagemetering/platform/bin/start-journal-service.sh

2. Find the following definition in start-journal-service.sh and change "512M" to “1536M”: 

   export MAX_MEMORY="512M"

3. Save the updated start-journal-service.sh and close vi editor.
4. Reboot Usage Meter appliance. (or execute the following script to restart all of the UM appliance services.)
   

   start.sh All -r

   
   Note : Take a snapshot of Usage Meter in advance to change the setting. After the issue is resolved, delete the snapshot.

Additional Information

Usage Meter による使用量データのアップロードが失敗する (420627) (Japanese)

reportFatalErorr call with errorCode 'ERR_THREAD_WATCHER' and error Message 'Issue detected for UploaderThreadsWatcher' in vCloud Usage Meter 4.8 (367515)