Error from mysqldump for DX NetOps Performance Management EM Database

Products

• CA Performance Management - Usage and Administration
• DX NetOps

Issue/Introduction

Trying to back up the em database in DX NetOps Performance Management and we're seeing errors.

Running this command:

/opt/CA/PC/MySql/bin/mysqldump em -unetqos -p<password> /tmp/em.sql

It returns the error:

mysqldump: Got error: 144: Table './em/item_members' is marked as crashed and last (automatic?) repair failed when using LOCK TABLES

We then tried to repair the table with the following command:

/opt/CA/PC/MySql/bin/mysqlcheck --repair -unetqos -p<password> em item_members

It fails with error:

error: Can't create new tempfile: './em/item_members.TMD'
status: Operation failed

Environment

All supported DX NetOps Performance Management releases

Cause

Disk full caused corrupted tables and prevented successful backup or repair.

Resolution

The primary cause found was a full disk. Adding space and restarting all services resolved that issue.

After this the errors remained due to *.TMD temp files that were left over. They were created and left over when the disk filled. Delete any *.TMD files referenced.

Full solution:

1. Add disk space.
2. Restart server and PC services including MySql
3. Run repair command.
4. Delete any *.TMD files that remain if repair reports inability to create new *.TMD file.
5. Once all TMD files are deleted and there is sufficient disk space the mysqlcheck and dump commands will now succeed.