[WARN] [IntroscopeAgent] Temporarily throttling the errors in the Agent Logs

Products

• CA Application Performance Management Agent (APM / Wily / Introscope)
• INTROSCOPE

Issue/Introduction

This article explains the cause of the “Temporarily throttling the errors” message and how to address this error.

Should we be concerned if seeing ?[WARN] [IntroscopeAgent] Temporarily throttling the errors?.? in the Agent Logs?

From time to time the following warning message may appear in Introscope Agent logs:

[WARN] [IntroscopeAgent] Temporarily throttling the errors sent because more than 10 have occurred in a short time

 

Environment

• CA Application Performance Management from 10.7 or higher

Cause

This warning is triggered by the Error Detector feature of the APM agent. Error Detector uses the errors.pbd file to detect and report information on errors occurring on the currently monitored application server.

When Error Detector finds an error, it generates an error snapshot providing component-level information on how the error occurred.

Resolution

What should we do if seeing the error snapshot throttle being exceeded?

These error snapshots can be resource-intensive to generate. As a result, to limit the error detector overhead on the monitored application, the agent restricts the number of snapshots generated to 10 in any 15 second interval.

This limit is configurable in the IntroscopeAgent.profile with the property:

introscope.agent.errorsnapshots.throttle=10.

Should this limit be exceeded, the message: “[WARN] [IntroscopeAgent] Temporarily throttling the errors sent because more than 10 have occurred in a short time” is logged.  (Note that raising this property may increase overhead on the monitored application.) 

First, review the monitored application server for potential issues. If the agent is generating more 10 errors snapshots in a 15 second interval, then there may be a serious issue occurring on the application server. 

Should no issues be occurring on the application server, then review the Error Detector configuration to ensure that meaningless errors are not being detected.

In the agent profile, you can exclude errors with the following property: introscope.agent.errorsnapshots.ignore.0= .

For example:

introscope.agent.errorsnapshots.ignore.0=*com.company.HarmlessException*

introscope.agent.errorsnapshots.ignore.1=*HTTP Error Code: 404*