"Detected health issues for services UploaderThreadsWatcher" notification on Usage Meter

Products

• VMware Cloud Director

Issue/Introduction

"Detected health issues for services UploaderThreadsWatcher" notification banner is displayed on the Usage Meter.

Error in dss_error.log:

2024-07-29 11:36:00.055 ERROR --- [ProcessWatcherThread] c.v.um.commoncomp.procwatch.ProcessInfo  : Not found 1 thread instances with name mask uploaderThread
2024-07-29 11:36:00.056 ERROR --- [ProcessWatcherThread] c.v.um.common.health.UmHealthReporter    : reportFatalErorr call with errorCode 'ERR_THREAD_WATCHER' and errorMessage 'Issue detected for UploaderThreadsWatcher'

Environment

VMware vCloud Usage Meter 4.6
VMware vCloud Usage Meter 4.7.x
VMware vCloud Usage Meter 4.8.x

Resolution

To remediate the health issues below are the steps to workaround by increasing the timeout values:

1. Take a SNAPSHOT of the Usage Meter appliance.
2. Login to SSH using "usagemeter" account
3. Switch to "root" account using "su -"
4. Run "cd /opt/vmware/cloudusagemetering/conf/"
5. Edit the file "vi dss_process.conf"
6. In uploader component inside -componentParams , add the following parameters:
     -readTimeoutSeconds 300
  -writeTimeoutSeconds 300 
   
   Example:
   [
    -componentName uploader
    -componentFactory  com.vmware.um.uploader.UploaderComponent.createInstance
    -componentParams {
        # This is the hostname of the event gateway to which usage data is uploaded.
        # The value of is configuration parameter is automatically changed at boot time
        # for GA builds. See scripts/first-boot.sh
        -uploadHost ums.cloud.vmware.com
        # Upload runs once an hour by default but you can change that here
        -uploadIntervalSeconds 3600
        -uploaderMaxThreads 1
        -rotatorMaxThreads 2
    -readTimeoutSeconds 300
    -writeTimeoutSeconds 300
    }
]

7. In processWatcher component, increase the watcher time from 15000 to 350000:
     -timeoutMs 350000
8. Save the file using ":wq!"
9. Reboot the appliance using "reboot -f"

After making the changes re-test the upload with Settings -> Send Update To Cloud Partner Navigator (CPN) by clicking on “Send Update to CPN”.