WILY MOM Crashing

Products

• CA Application Performance Management (APM / Wily / Introscope)

Issue/Introduction

MOM keeps crashing intermittently

Environment

Release : 10.7.0

Component : CA DOI Foundations

Cause

From heap dump:

Agent: Custom Metric Host \(Virtual\)\|Custom Metric Process \(Virtual\)\|Custom Business Application Agent \(Virtual\) 

Metric: 

By Frontend\|(.*)\|Health:Stall Count

By Frontend\|(.*)\|Health:Errors Per Interval

Top-N filter: top 25

 

We are getting back 1752 metrics, each metric with up to 26k data points, that takes 5GB.

 

The other Query is the same as the 1st one. Not sure if customer was refreshing the same top-N graph.

 

We can set a clamp on the data points to avoid the crash:

introscope.enterprisemanager.query.returneddatapointlimit=1000000

Resolution

Setting introscope.enterprisemanager.query.returneddatapointlimit to 100000 on the MOM only resolved the issue.