Workstation Investigator only shows EMHOST and EMPORT metrics

Products

• CA Application Performance Management Agent (APM / Wily / Introscope)
• INTROSCOPE

Issue/Introduction

Description:

Adding a new application to monitoring and only metrics showing up in workstation are EMHOST and EMPORT

Solution:

Check the following clamp metrics:

For Live Metric Clamping
<domain> | Custom Metric Host (Virtual) | Custom Metric Process (Virtual) |
Custom Metric Agent (Virtual) (Collector name) | Enterprise Manager |
Connections: EM Live Metric Clamped

For Historical Metric Clamping
<domain> | Custom Metric Host (Virtual) | Custom Metric Process (Virtual) |
Custom Metric Agent (Virtual) (Collector name) | Enterprise Manager |
Connections: EM Historical Metric Clamped

and see if any one shows 1 instead of 0, if so it means the clamp has been reached. EM log will show this:
The EM has too many historical metrics reporting from Agents and will stop accepting new metrics from Agents. Current count = 1200555. Max count = 1200000

You can also verify number of actual metrics:

For number of Live Metrics
<domain> | Custom Metric Host (Virtual) | Custom Metric Process (Virtual) |
Custom Metric Agent (Virtual) (Collector name) | Enterprise Manager |
Connections: Number of Metrics

For number of Historical Metrics
<domain> | Custom Metric Host (Virtual) | Custom Metric Process (Virtual) |
Custom Metric Agent (Virtual) (Collector name) | Enterprise Manager |
Connections: Number of Metrics

By default,
introscope.enterprisemanager.metrics.live.limit is set to 500,000
and
introscope.enterprisemanager.metrics.historical.limit is set to 1,200,000

these settings can be found in "apm-events-thresholds-config.xml" on EM:

<clamp id="introscope.enterprisemanager.metrics.live.limit">
      <description>
          Per EM limit. Takes into account only live metrics (i.e. currently reporting from Agents)
      </description>
      <threshold value="500000"/>
</clamp>
<clamp id="introscope.enterprisemanager.metrics.historical.limit">
     <description>
         Per EM limit. Takes into account metrics with Smartstor data (i.e. live and historical metrics)
      </description>
      <threshold value="1200000"/>
</clamp>

You can increase these values, ie. introscope.enterprisemanager.metrics.historical.limit to 2,000,000 (we've seen a client setting this to 5 million), to avoid clamping and to see metrics.

Environment

Release:
Component: APMINT