Unable to access Spectrum OneClick client console

Products

• CA Spectrum
• DX NetOps

Issue/Introduction

Spectrum OneClick is inaccessible, both via java client console and Web GUI. Looking at the stdout.log, see it has many of the following and stops after it:

Mar 08, 2023 08:26:49.213 - WARNING: Tomcat not started yet

Environment

DX NetOps Spectrum Release : 21.2.x

Cause

Checking on the OneClick server showed that resources were not being heavily used (CPU & memory utilisation both around 15% or less).

Checking the MLS showed it was at 100% CPU and isn't accessible via either Command line (CLI) or Spectrum Control Panel (SCP). When this happens, then the OneClick server gets no response when trying to communicate with it and so stalls.

Reboot the MLS server and afterwards, found many out of memory errors in the VNM.OUT log with many dmp files created.

 

Resolution

After the MLS reboot, SpectroSERVER wouldn't start due to LocServer not running properly. Stopped and restarted processd, which then allowed LocServer to run normally again.

Then restored previous day's SSdb backup and restarted MLS. After this, OneClick was able to connect and worked properly.