CA APM Introscope stop intermittently after certain interval

book

Article ID: 145563

calendar_today

Updated On:

Products

CA Application Performance Management Agent (APM / Wily / Introscope) CA Application Performance Management (APM / Wily / Introscope) INTROSCOPE DX Application Performance Management

Issue/Introduction

After successful MOM HA failover, Introscope Enterprise Manager stops after 13-14 hours or interval. 
Currently, it is not running as a Windows service. Started with user id by EnterpriseManager.exe.
It closes automatically after certain interval of time. 

Cause

The EM cannot connect to the DB.

From the log Analysis:

[ERROR] [PO Route Down Executor] [Manager] Uncaught Exception in Enterprise Manager: In thread 'PO Route Down Executor' and the message is: org.springframework.jdbc.CannotGetJdbcConnectionException: Could not get JDBC Connection; nested exception is java.sql.SQLException: HikariDataSource HikariDataSource (HikariPool-1) has been closed.
org.springframework.jdbc.CannotGetJdbcConnectionException: Could not get JDBC Connection; nested exception is java.sql.SQLException: HikariDataSource HikariDataSource (HikariPool-1) has been closed.

This is the APM DB that is a required part of the installation, it would not directly affect all the metrics and traces can see in Introscope Investigator but the product is not designed to run without the successful database connection.

This error shows up normally, 
1. Either the database is not running,
2. the user credentials may be incorrect (this can be verified in Postgres log) .
3. There could be something like firewall blocking between EM and database.

Environment

Release : 10.5

Component : Introscope

Resolution

1. Make sure the APM Database is up and running
2. Make sure the User credentials are set correctly.
 The configuration for the database connection is stored in tess-db-cfg.xml, which is in the config folder of Enterprise Manager.
Please make sure its configured correctly
3. Make sure there is no firewall configured between EM and Database servers.