UIM 20.4 Upgrade is failing on startup of alarm

Products

DX Unified Infrastructure Management (Nimsoft / UIM) CA Unified Infrastructure Management On-Premise (Nimsoft / UIM) CA Unified Infrastructure Management SaaS (Nimsoft / UIM)

Issue/Introduction

Upgrading from 20.3.3 to 20.4 and getting the following error in the installation log:

2023-02-01 20:25:25,061 ERROR impl.UIMServerConfigureController:run:478 [Thread-40] - NimException caught
(6) permission denied, Failed to communicate with probe 'alarm_enrichment' in the allotted time of 300 secs.
at com.nimsoft.install.nimcommon.probe.ProbeController.waitForResponse(ProbeController.java:257)
at com.nimsoft.install.uimserver.action.impl.UIMServerConfigureController.waitForProbeToRespondCommon(UIMServerConfigureController.java:3303)
at com.nimsoft.install.uimserver.action.impl.UIMServerConfigureController.waitForProbeToRespondCommon(UIMServerConfigureController.java:3289)
at com.nimsoft.install.uimserver.action.impl.UIMServerConfigureController.configureNas(UIMServerConfigureController.java:1716)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.nimsoft.install.nimcommon.method.NimMethodCallback.invokeMethod(NimMethodCallback.java:532)
at com.nimsoft.install.nimcommon.method.NimMethodCallback.invokeMethod(NimMethodCallback.java:516)
at com.nimsoft.install.uimserver.action.impl.UIMServerConfigureController.doConfigure_postNMSStartupPackages(UIMServerConfigureController.java:531)
at com.nimsoft.install.uimserver.action.impl.UIMServerConfigureController.doConfigure(UIMServerConfigureController.java:492)
at com.nimsoft.install.uimserver.action.impl.UIMServerConfigureController.run(UIMServerConfigureController.java:476)
at java.lang.Thread.run(Thread.java:748)

Environment

Release: 20.4
Component: alarm_enrichment

Resolution

Steps to resolve:

Login to the Infrastructure Manager (IM)
Deactivate the alarm_enrichment probe. (In this case, the alarm_enrichment probe was green, but did not have a port or a pid)
Then deploy the nas probe from the local archive to the Primary hub robot.
After these steps, alarm_enrichment was able to be started and the installation (upgrade) continued.

Additional Information

There were a bunch of minidump and dump log files that were in the nas directory. We tried to clean out those files but it appears that there are some that are locked by another process. Those locked by another process actually were from the previous day.

Alternatively, it may be simpler to set the Nimsoft Robot Watcher service to disabled, reboot the primary server, and once back up, remove the dump files and dump related log files from the nas directory.

Then reset the Nimsoft Robot Watcher service to Delayed Start, Activate the service, and Restart the installation process.