search cancel

NetOps Performance Manager upgrade is hanging

book

Article ID: 237735

calendar_today

Updated On:

Products

CA Performance Management - Usage and Administration DX NetOps

Issue/Introduction

We are upgrading PM from 21.2.6 to 21.2.8. I know with this upgrade MySQL will be upgraded to MySQL 8 and it should take some time.

It has been over 30 min now, it seems to be on the same spot

===============================================================================
Installing...
-------------

 [==================|==================|==================|==================]
 [------------

When I looked at the Installation Directory, nothing seems to be happening. Why aren't the logs being written to?

[<User>@<PC_Host> InstallLogs]$ ls -ltr | tail
-rwxr-xr-x. 1 caadmin root   61554 Jan 27 20:53 MySql_Install_01_27_2022_20_52_48.log
-rw-rw-r--. 1 caadmin root  948658 Jan 27 20:55 seedlu.log.2022-01-27-20_54-06
-rw-rw-r--. 1 caadmin root  438545 Jan 27 20:55 dbmigrate.log.2022-01-27_20-54
-rwxr-xr-x. 1 caadmin root   70330 Jan 27 20:55 Performance_Center_SSO_Install_01_27_2022_20_55_30.log
-rwxr-xr-x. 1 caadmin root   77351 Jan 27 20:56 Performance_Center_Device_Manager_Install_01_27_2022_20_55_52.log
-rwxr-xr-x. 1 caadmin root  116902 Jan 27 20:56 Performance_Center_Event_Manager_Install_01_27_2022_20_56_12.log
-rwxr-xr-x. 1 caadmin root  295556 Jan 27 20:56 Performance_Center_Console_Install_01_27_2022_20_56_34.log
-rw-rw-r--. 1 caadmin root    3641 Jan 27 20:56 emmigrate.log.2022-01-27_20-54
-rwxr-xr-x. 1 root    root  289963 Jan 27 20:57 Performance_Center_Install_01_27_2022_20_57_15.log
-rw-rw-r--. 1 root    root       0 Mar 24 14:20 pre_mysql_upgrade.log.2022-03-24_14-20

We do see the mysql process running and consuming resources, while the four main PC services are shut down.

When entering the MySql prompt and running the "show processlist;" command we see a DELETE statement for alarms as the longest running query.

Cause

Hanging DELETE statement for Alarms in MySql DB due to setting Spectrum Data Source to Disabled during upgrade run.

Environment

All DX NetOps Performance Management releases 21.2.7 and earlier.

Resolution

The steps from the following Knowledge Base Article should be used to resolve this. Killing off the offending DELETE statement will allow the rest of the install run complete without issue.

Event Manager shows synchronization failure in DX NetOps

Additional Information

It is safe to enter the MySql prompt to run queries during the upgrade.

Be sure to ONLY run queries that show information.

Never run queries that change anything while the upgrade is actively running.