APM Introscope is not available

Products

• CA Application Performance Management Agent (APM / Wily / Introscope)
• CA Application Performance Management (APM / Wily / Introscope)
• INTROSCOPE
• DX Application Performance Management

Issue/Introduction

APM Introscope is not available. The APM MOM EM service does not start. em.log is showing following errors.

java.lang.OutOfMemoryError: Java heap space
Dumping heap to ./logs/java_pid1622.hprof ...
Heap dump file created [5927179932 bytes in 70.459 secs]
.
.
java.lang.OutOfMemoryError: Java heap space
 at java.util.concurrent.locks.AbstractQueuedSynchronizer.enq(AbstractQueuedSynchronizer.java:587)
 at java.util.concurrent.locks.AbstractQueuedSynchronizer.transferAfterCancelledWait(AbstractQueuedSynchronizer.java:1699)
 at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2159)
 at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.reservedWait(ReservedThreadExecutor.java:292)
 at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:357)
 at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:762)
 at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:680)
 at java.lang.Thread.run(Thread.java:745)

Environment

Release : 10.7.0

Component : APM Agents

Resolution

STOP MOM, COLLECTORS and Postgree.

Set / adjust in MOM and COLLECTORS.

In IntroscopeEnterpriseManager.properties

introscope.apm.data.preserving.time=30 DAYS
introscope.apm.alert.preserving.time=15 DAYS
introscope.apm.data.obsolete.time=29 DAYS

Set the heap size on MOM:

In Introscope_Enterprise_Manager.lax

lax.nl.java.option.additional=... -Xms12288m -Xmx12288m

Set the heap size on COLLECTORS:

In Introscope_Enterprise_Manager.lax

lax.nl.java.option.additional=... -Xms8192m -Xmx8192m

On MOM and COLLECTORS

Delete all content [all files and directories] under the /work folders

Delete all content [all files and directories] under the /configuration folder, except the config.ini file (DO NOT delete the config.ini file)

Path:
<EM-HOME>/product/enterprisemanager/configuration

Delete all files in:
/logs

Restart the machines (MOM and COLLECTORS)

Start postgres
wait for start to completely.
test whether postgres is working.

Start COLLECTORS
wait for start to completely.

Start MOM