DX APM - apm-logstash pod restarts

Products

• CA Application Performance Management (APM / Wily / Introscope)

Issue/Introduction

apm-logstash pod is unable to startup and keeps restarting

Symptoms:

- the apm-logstash pod reports below errors:

#kubectl logs apm-logstash-10-534228-6485bf6568-j89tq -n dxi

...
APM Logstash installation directory is /usr/share/logstash/dxc

ERROR: Something went wrong when installing /usr/share/logstash/dxc/apm-logstash-plugin/logstash-output-apm-2.5.0.9.gem, message: Failed to open TCP connection to artifacts.elastic.co:443 (execution expired)
..

[2019-12-12T12:49:01,037][ERROR][logstash.plugins.registry] Tried to load a plugin's code, but failed. {:exception=>#<LoadError: no such file to load -- logstash/outputs/apm>, :path=>"logstash/outputs/apm", :type=>"output", :name=>"apm"}

 

- In APM 11 install.log, no error messages are found :

2019-11-28 13:32:50,722 INFO  - [oerth-scx.ca.com:4443/apmservices/gateway:11.1.3.33-linux-amd64] Image apm.acme.com:5000/ng/gateway:11.1.3.33-linux-amd64 successfully tagged in: 20.63 ms
2019-11-28 13:32:50,726 INFO  - [oerth-scx.ca.com:4443/apm-logstash-plugin-image:1.1.7] Tagging image: apm11.acme.com:5000/ng/logstash:1.1.7.
...

Cause

This problem is related to defect # DE442181 

apm-logstash requires internet to download some dependencies, as there is not internet access, apm-logstash pod is unable to startup and keeps restarting.

Environment

APM 11.1.3.33

Offline installation

No connection to internet

Resolution

This defect will be fixed in APM 19.4

If you are using 11.1.3 and need access to the fix, open a support case and request:

a)  Copy of New apm-logstasth-1.1.10.tar image (size=2.4GB)
b)  Installation instructions how to deploy the new image