Global Sync Failed in CA Performance Management (CAPM)

Products

• CA Infrastructure Management
• CA Performance Management - Usage and Administration
• DX NetOps

Issue/Introduction

The global synch is not completing and DA and spectrum data sources stay in synchronizing state.

Global Synchronization Status
Last Run Status: Failed

Environment

DX NetOps CAPM 20.2 or later

Cause

Services were started and then stopped in the middle of the spectrum synch, and an sql call was not completed.

The following exception is shown in the DMService.log:

INFO   | jvm 1    | 2020/09/10 16:55:12 |       | Start firstPollLoop

STATUS | wrapper  | 2020/09/10 17:02:06 | TERM trapped.  Shutting down.

INFO   | jvm 1    | 2020/09/10 17:04:54 |       | Start firstPollLoop
…
INFO   | jvm 1    | 2020/09/10 17:04:54 | java.util.concurrent.ExecutionException: org.springframework.dao.DuplicateKeyException: StatementCallback; SQL [CALL sp_reset_item_mapping_table()]; Duplicate entry '69975681' for key 'PRIMARY'; nested exception is com.mysql.jdbc.exceptions.jdbc4.MySQLIntegrityConstraintViolationException: Duplicate entry '69975681' for key 'PRIMARY'

So the sql call did not complete and now there are duplicate entries in the table.

Resolution

1. stop DM/PC/EM/SSO
   
   systemctl stop caperfcenter_console; systemctl stop caperfcenter_devicemanager; systemctl stop caperfcenter_eventmanager; systemctl stop caperfcenter_sso;
   
   
2. Then, login to the CAPC MySQL netqosportal DB (your <PASSWORD> will vary):
   
   cd /opt/CA/MySql/bin
   ./mysql -unetqos -p<PASSWORD> netqosportal
   
   
3. At the MySQL prompt, run;
   
   mysql> show processlist;  
   
   
4. Make sure no sql calls are being made.
   
   
5. Next run this sql command:
   
   delete from item_mapping; 
   
   
6. Then, restart the CAPC processes:
   
   systemctl start caperfcenter_sso; sleep 30; systemctl start caperfcenter_devicemanager; sleep 30; systemctl start caperfcenter_eventmanager; sleep 30; systemctl start caperfcenter_console;