Collector service periodically becomes unreponsive when HTTP Post Adapter is used with vRealize Operations Manager
search cancel

Collector service periodically becomes unreponsive when HTTP Post Adapter is used with vRealize Operations Manager

book

Article ID: 340553

calendar_today

Updated On:

Products

VMware Aria Suite

Issue/Introduction

Symptoms:
When the HTTP Post Adapter has been configured on vRealize Operations Manager (vApp) 5.x (formerly known as VMware vCenter Operations Manager vApp):
  • An alert may be generated stating that the vRealize Operations Collector is down.
  • An alert may be generated stating that the Queue has grown to an excessive size or is full.
  • The Queues > dataQueue > Queue Size metric is at a consistently high value.
  • The $ALIVE_BASE/user/log/collector.log file may contain entries similar to:

    ERROR [Communicator] com.integrien.alive.collector.CollectorMain.uncaughtException - Thread Communicator threw an uncaught exception. Excetion was: java.lang.OutOfMemoryError: Java heap space
    java.lang.OutOfMemoryError: Java heap space

    FATAL [Collector worker thread 24] com.integrien.alive.collector.CommunicatorThread.forwardData - Failed to send data: ActiveMQ is backing up, data is being lost!


Cause

The OpenAPI Adapter is responsible for buffering HTTP Post Adapter data in memory. It is possible that the OpenAPI Adapter can use memory enough to starve the collector process and cause it to become unresponsive.

Resolution

To help prevent this behavior, reduce the amount of memory available to the OpenAPI Adapter:
  1. Log in to the Analytics VM as the admin user.

  2. Open the $ALIVE_BASE/user/conf/collector/collector.properties file with a text editor.

  3. Find the line that begins with:

    pushAdapterBufferLimit=

  4. Change the pushAdapterBufferLimit value to approximately 75% of the current value.

  5. Save and close the file.

  6. Restart the collector process by running the command:

    service vcops restart collector


Additional Information

If the Collector service continues to become unresponsive after reducing the memory available to the OpenAPI Adapter, it may be necessary to reduce the pushAdapterBufferLimit value further.