Gateway container not able to connect to DB due to DATABASECHANGELOGLOCK

Products

• CA API Gateway

Issue/Introduction

The gateway container log shows DB connection timeout,

# docker logs 312a7bc82e10
Using MySQL database
SSG_DATABASE_WAIT_TIMEOUT set to 300 seconds.
SSG_JVM_HEAP will be 16g
SSG_CLUSTER_HOST will be *********
SSG_GC_ARGS will be -XX:+PrintGCDetails -Xloggc:/opt/SecureSpan/Gateway/node/default/var/logs/ssg_gc.log
Waiting for one of the databases to come up...

Test mysql connection on docker host is fine.

 

 

Environment

Release : 10.1

Component : API GATEWAY

Cause

In ssg database, run the query,

mysql> select * from DATABASECHANGELOGLOCK;

It shows the DB is LOCKED.

 

It's possibly due to a killed process not releasing its lock on the DATABASECHANGELOGLOCK table.

Resolution

UPDATE DATABASECHANGELOGLOCK SET locked=0;