The Introscope EM fails to start - org.rocksdb.RocksDBException: Corruption: checksum mismatch

Products

• CA Application Performance Management Agent (APM / Wily / Introscope)
• INTROSCOPE

Issue/Introduction

The Introscope EM fails to start. org.rocksdb.RocksDBException: Corruption: checksum mismatch

Environment

Applies to any APM 10.5.0, 10.5.1, 10.7

Cause

The issue is due to bug # DE280064 - transaction log corruption due to unclean shutdown of the Introscope EM (kill, lack of space, EM crash)

This defect is fixed in :

- APM 10.5.2

- APM 10.5.1 Hotfix 9 and above.  Open a CA support case if you need access to the hotfix

Resolution

Manually delete the latest transaction log, the file is under data/metadata/LOG or delete latest 0000XXX.log

1. Open the Introscope EM log and identify the latest transaction log file name you need to delete, below an example:

3/13/17 10:20:16.605 AM CET [ERROR] [Smartstor/Superstor Spool] [Manager.MetadataStore]

com.wily.introscope.server.enterprise.entity.meta.MetadataException: org.rocksdb.RocksDBException: IO error: data/metadata/000309.log: There is not enough space in the file system.

2. Take a backup of the EM_HOME/data/metadata folder

3. Delete the EM_HOME/data/metadata/000309.log

4. Start the EM