All deployments are blocked in initialization phase after upgrade

Products

• CA Release Automation - Release Operations Center (Nolio)
• CA Release Automation - DataManagement Server (Nolio)

Issue/Introduction

After upgrade of Release Automation from 6.9.2 to 6.9.3, all the deployments were in block state in the init phase.

Environment

Release Automation 6.9.3

Resolution

Root cause is not yet known but if problem occurs again do this :

1- Do a copy of file log4j2.properties

cd /opt/nolio/webapps/datamanagement/WEB-INF
cp log4j2.properties log4j2.properties.cop

 

2- edit file /opt/nolio/webapps/datamanagement/WEB-INF/log4j2.properties

and change the lines in bold :

appender.RegularDMAppender.policies.size.size=100Mb
appender.RegularDMAppender.strategy.type=DefaultRolloverStrategy
appender.RegularDMAppender.strategy.max=10
appender.RegularDMAppender.strategy.fileIndex=min
...
...
# nolio all
logger.NolioAll.name=com.nolio
logger.NolioAll.level=DEBUG
logger.NolioAll.appenderRef.RegularDMAppender.ref=RegularDMAppender
logger.NolioAll.additivity=false
logger.NolioHibernate.name=com.nolio.hibernate
logger.NolioHibernate.level=INFO
logger.NolioHibernate.additivity=false
logger.NolioHibernate.appenderRef.RegularDMAppender.ref=RegularDMAppender
logger.JDBCSQLTiming.name=jdbc.sqltiming
logger.JDBCSQLTiming.level=FATAL
logger.JDBCSQLTiming.appenderRef.RegularDMAppender.ref=RegularDMAppender
logger.JDBCSQLTiming.additivity=false
logger.MonitoringThread.name=MonitoringThread
logger.MonitoringThread.level=DEBUG
logger.MonitoringThread.appenderRef.MonitoringThreadAppender.ref=MonitoringThreadAppender
logger.MonitoringThread.additivity=false
logger.ServersConnectivityScannerImpl.name=com.nolio.platform.server.dataservices.services.execmng.ServersConnectivityScannerImpl
logger.ServersConnectivityScannerImpl.level=DEBUG

logger.ExecutionStatusServiceImpl.name=com.nolio.platform.server.dataservices.services.execution.ExecutionStatusServiceImpl
logger.ExecutionStatusServiceImpl.level=DEBUG
logger.ExecutionStatusServiceImpl.appenderRef.StatusesServiceAppender.ref=StatusesServiceAppender
logger.ExecutionStatusServiceImpl.additivity=false

 

3- Restart NAC service

cd <RA_HOME>
./nolio_server.sh stop
./nolio_server.sh start

 

4- Open JMX page 

http://nac_server_name:20203/mbean?objectname=Logging%3Atype%3DLog4j

Replace nac_server_name by the name of NAC server

Default login / password is nolio/nolio

Click Invoke button for "turnOnHibernateSQLLogging" and "turnOnHibernateBindParameterLogging"

 

5- Create a new Deployment to reproduce the problem.

6- Wait 5 minutes, create a zip of directory <RA_HOME>/logs of NAC

Open a case at Broadcom support with the zip of logs directory