AIOps - Unable to login, postgresql pod in CrashLoopBackOff

Products

• DX Operational Intelligence
• DX Application Performance Management
• CA App Experience Analytics

Issue/Introduction

Symptoms:

- Unable to login
- dxi-postgresql pod is in CrashLoopBackOff status
- postgres pod logs reports the below messages

2022-03-16 09:26:16.383 UTC [26] LOG:  listening on Unix socket "/var/run/postgresql/.s.PGSQL.5432"
2022-03-16 09:26:16.385 UTC [26] LOG:  listening on Unix socket "/tmp/.s.PGSQL.5432"
2022-03-16 09:26:16.990 UTC [26] LOG:  redirecting log output to logging collector process
2022-03-16 09:26:16.990 UTC [26] HINT:  Future log output will appear in directory "log".
.... stopped waiting
pg_ctl: could not start server
Examine the log output.

 

Environment

DX Platform 2x

Cause

Insufficient allocated disk space

pg-data-clamp pvc had been manually reconfigured and reduced from 1GB to 300MB and only 34Mb was available.

Resolution

Increase capacity to the pg-data-clamp PVC

As per documentation: https://techdocs.broadcom.com/us/en/ca-enterprise-software/it-operations-management/dx-platform-on-premise/21-3/installing/Hardware-software-requirements.html

Starting from 21.3.x, the min requirement is 50GB

 

NOTE: 

If you are using DX Platform 20.2.1, do not change the default allocated capacity as DSP functionality (dsp_db) requires a lot of space.  dsp db is no longer used in 21.3 or later versions. 

Additional Information

https://knowledge.broadcom.com/external/article/190815/aiops-troubleshooting-common-issues-and.html