Performance Management - Mysql service will not start after installing NetOps Portal

Products

• CA Performance Management - Usage and Administration
• DX NetOps

Issue/Introduction

After installing NetOps Portal, Mysql service will not start:

● mysql.service - MySQL daemon
   Loaded: loaded (/etc/systemd/system/mysql.service; enabled; vendor preset: disabled)
   Active: failed (Result: exit-code) since Thu 2021-02-18 11:26:37 CET; 17s ago
  Process: 2381 ExecStop=/opt/application/CA/MySql/support-files/mysql.server stop (code=exited, status=0/SUCCESS)
  Process: 126809 ExecStart=/opt/application/CA/MySql/support-files/mysql.server start (code=exited, status=1/FAILURE)
 Main PID: 1768 (code=exited, status=0/SUCCESS)

<host> systemd[1]: Starting MySQL daemon...
<host> mysql.server[126809]: Starting MySQL. ERROR! The server quit without updating PID file (/opt/application/CA/MySql/data/hostname.app.gen.local.pid).
<host> systemd[1]: mysql.service: control process exited, code=exited status=1
<host> systemd[1]: Failed to start MySQL daemon.
<host> systemd[1]: Unit mysql.service entered failed state.
<host> systemd[1]: mysql.service failed.

 

and PCService.log shows the 

INFO   | jvm 1    | ERROR | qtp1668551224-24         | 2021-02-17 09:42:44,108 | com.ca.im.portal.api.services.interfaces.user.RoleService        
INFO   | jvm 1    |       | service.role.error.getting.role 3
INFO   | jvm 1    |       | org.springframework.jdbc.UncategorizedSQLException: StatementCallback; uncategorized SQLException for SQL [SELECT t.RoleID, IFNULL(t.Name,IFNULL(i18n.Name,'')) AS Name, IFNULL(t.Description,IFNULL(i18n.Description,'')) AS Description, t.Enabled, t.TenantID, t.RoleFlag, t.UpdatedOn FROM role_definitions t LEFT JOIN (SELECT dflt.RoleID, IFNULL(locale.Name, dflt.Name) AS Name, IFNULL(locale.Description, dflt.Description) AS Description FROM role_definitions_i18n dflt LEFT JOIN role_definitions_i18n locale ON dflt.RoleID=locale.RoleID AND locale.CultureID=(IF((SELECT CultureID FROM role_definitions_i18n WHERE CultureID='en-US' LIMIT 1) = 'en-US', 'en-US', (SELECT DISTINCT CultureID FROM role_definitions_i18n WHERE CultureID LIKE (CONCAT(SUBSTR('en-US',1,2),'%')) LIMIT 1))) WHERE dflt.CultureID='en-US') i18n ON i18n.RoleID=t.RoleID WHERE t.RoleID=3]; 
SQL state [HY000]; error code [1036]; Table 'role_definitions_i18n' is read only; nested exception is java.sql.SQLException: Table 'role_definitions_i18n' is read only

Environment

Dx NetOps Performance Management any version

Cause

The ..MySql/data, ..MySql/tmp directories and all sub-directories should be owned by mysql and for this particular case it was owned by the sudo user:

 

Resolution

To resolve this issue we would need to address the mysql permission/owner issue and make MySql/data, MySql/tmp directories and all sub-dirs to be owned by mysql.

1.- Run below commands to chown the relevant mysql directories to mysql user (update the paths and <sudouser> accordingly):

chown -R mysql:mysql /opt/application/CA/Mysql/data
chown -R mysql:<sudouser> /opt/application/CA/Mysql/tmp

2.- Double-check to make sure the changes has been applied and restart the NetOps Portal services as follows:
service mysql start
service caperfcenter_sso start 

--> at this point wait for a minute for the service to be completely up
service caperfcenter_eventmanager start
service caperfcenter_devicemanager start

--> at this point wait again for a minute
service caperfcenter_console start

This should address this issue, otherwise please contact Broadcom Support for advice.

Additional Information

MySQL Fails to Start After Installation/upgrade
https://knowledge.broadcom.com/external/article?articleId=142976

Unable to start MySql service in Performance Management
https://knowledge.broadcom.com/external/article?articleId=195683