Unable to login to APM 11 login UI, apmservices-gateway, dxportal, tenant:
“Failed to login. Verify that user ID and password are correct”
Postgres "dsp_db" database is corrupted,
In this case, the file-system of the NFS server ran out of disk space damaging some data files
It is not possible to recover the data files.
You can confirm this condition from the postgres log, there is a message indicating that dsp_db is corrupted:
cd /nfs/ca/dxi/axaservices/pg-data/userdata/pg_log
tail -f postgresql-<day>.log
You can try to recreate the initial state of postgres databases but data created after installation will be lost.
Restoring the "aoplatform" database should allow you to login to the existing tenants as it contains primary information related to the tenants configuration.
NOTE: to list all the databases in postgres:
a) obtain the postgres pod name
kubectl get pods -ndxi | grep post
postgresql-77c878cc47-76hwm 1/1 Running 0 26s
b) login to pod
kubectl exec -it postgresql-77c878cc47-76hwm -ndxi bash
c) list databsaes
psql -U postgres -d postgres
postgres=# \l
List of databases
Name | Owner | Encoding | Collate | Ctype | Access privileges
------------+----------+----------+------------+------------+-----------------------
aoplatform | aopuser | UTF8 | en_US.utf8 | en_US.utf8 | =Tc/aopuser +
| | | | | aopuser=CTc/aopuser
apmpe | apmpe | UTF8 | en_US.utf8 | en_US.utf8 |
cpa | aopuser | UTF8 | en_US.utf8 | en_US.utf8 | =Tc/aopuser +
| | | | | aopuser=CTc/aopuser
doi | aopuser | UTF8 | en_US.utf8 | en_US.utf8 | =Tc/aopuser +
| | | | | aopuser=CTc/aopuser
dsp_db | aopuser | UTF8 | en_US.utf8 | en_US.utf8 | =Tc/aopuser +
| | | | | aopuser=CTc/aopuser
dxi | dxi | UTF8 | en_US.utf8 | en_US.utf8 |
postgres | postgres | UTF8 | en_US.utf8 | en_US.utf8 |
template0 | postgres | UTF8 | en_US.utf8 | en_US.utf8 | =c/postgres +
| | | | | postgres=CTc/postgres
template1 | postgres | UTF8 | en_US.utf8 | en_US.utf8 | =c/postgres +
| | | | | postgres=CTc/postgres
(9 rows)
postgres=# \q
APM 11.x, APM 19.x