apm-logstash pod is unable to startup and keeps restarting
Symptoms:
- the apm-logstash pod reports below errors:
#kubectl logs apm-logstash-10-534228-6485bf6568-j89tq -n dxi
...
APM Logstash installation directory is /usr/share/logstash/dxc
ERROR: Something went wrong when installing /usr/share/logstash/dxc/apm-logstash-plugin/logstash-output-apm-2.5.0.9.gem, message: Failed to open TCP connection to artifacts.elastic.co:443 (execution expired)
..
[2019-12-12T12:49:01,037][ERROR][logstash.plugins.registry] Tried to load a plugin's code, but failed. {:exception=>#<LoadError: no such file to load -- logstash/outputs/apm>, :path=>"logstash/outputs/apm", :type=>"output", :name=>"apm"}
- In APM 11 install.log, no error messages are found :
2019-11-28 13:32:50,722 INFO - [oerth-scx.ca.com:4443/apmservices/gateway:11.1.3.33-linux-amd64] Image apm.acme.com:5000/ng/gateway:11.1.3.33-linux-amd64 successfully tagged in: 20.63 ms
2019-11-28 13:32:50,726 INFO - [oerth-scx.ca.com:4443/apm-logstash-plugin-image:1.1.7] Tagging image: apm11.acme.com:5000/ng/logstash:1.1.7.
...
This problem is related to defect # DE442181
apm-logstash requires internet to download some dependencies, as there is not internet access, apm-logstash pod is unable to startup and keeps restarting.
APM 11.1.3.33
Offline installation
No connection to internet
This defect will be fixed in APM 19.4
If you are using 11.1.3 and need access to the fix, open a support case and request:
a) Copy of New apm-logstasth-1.1.10.tar image (size=2.4GB)
b) Installation instructions how to deploy the new image