Spectrum ArchMgr not fully initializing and Events show down in OneClick

Products

• CA Spectrum
• DX NetOps

Issue/Introduction

The Archive Manager process is running but is not fully initializing.  In the Connection Status window of OneClick it shows down for the Events service.

In the log $SPECROOT/SS/DDM/ARCHMGR.OUT there are the following entries:

Aug 28 13:30:33 : ArchMgr started as user 'spectrum'

Aug 28 13:30:33 : ArchMgr validating database.

Aug 28 13:30:33 : ArchMgr successfully connected to MySQL daemon

Aug 28 13:30:33 : ArchMgr loaded DDM database with landscape handle 0x100000

 

The following entries are missing and should show (once a proper connection has been made to the SS and OneClick)

Aug 28 13:35:00 : ArchMgr has successfully connected to the SpectroSERVER.

Aug 28 13:35:00 : ArchMgr has successfully advertised CORBA Event Service.

Aug 28 13:35:00 : ArchMgr is now ready on port 0xbeef, precedence 10

Environment

DX NetOps Fault Spectrum

Cause

• The initialization did not occur properly as LocServer.exe was not starting successfully with the start of processd.
• The LocServer process is not running
• The following message was logged to $SPECROOT/lib/SDPM/processd_log

Failure to connect to Location Service at host: spectroserver003, port #: 56063

• Netstat -anp | grep 56063 shows the above referenced port is not in use.

Resolution

1. Restart Processd:
2. Stop processd (./systemctl stop processd) 
3. Delete contents of $SPECROOT/lib/SDPM/runtime folder (rm -f *rtt)
4. Start processd (systemctl start processd
5. Verify LocServer is running (ps -ef | grep LocServer)
6. Review the $SPECROOT/SS/DDM/ARCHMGR.OUT to verify the log shows all connections are successful.