AWA: Event Engine events fail and unable to restart - org.postgresql.util.PSQLException: An I/O error occurred while sending to the backend.

Products

• CA Automic Workload Automation - Automation Engine

Issue/Introduction

When utilizing the Event Engine, the Events within the Automation Engine go into a FAILED status and reviewing the analytics_backend.log shows errors similar to:

org.postgresql.util.PSQLException: An I/O error occurred while sending to the backend.
ERROR 108857 --- [http-nio-8090-exec-3] c.a.a.backend.security.ApiKeyCache       : Error while fetching API keys
java.sql.SQLTransientConnectionException: ds_analytics - Connection is not available, request timed out after 93663ms.
Source: Kafka Event Queue for Client 100 (1/1) @url:39150: java.lang.Exception: TaskManager was lost/killed: 2ce93aad94d14d864a70a951b34c2d95 @ url (dataPort=39150)

Environment

Release : 12.3

Component : AUTOMATION ENGINE

Cause

Network Communication Issue

Resolution

The errors above point at an inability for communication to complete between the components of the Event Engine. Please check that all hosts involved are able to communicate with each other and are active. If so, stop all components and the restart:

- Analytics backend DB
- Flink
- Kafka
- The IA Agent

At this point, check the newly generated analytics_backend.log to confirm the above errors are removed.