UIM Server upgrade to 20.4 CU4 fails at 15% and then 37%

Products

• DX Unified Infrastructure Management (Nimsoft / UIM)
• CA Unified Infrastructure Management On-Premise (Nimsoft / UIM)
• CA Unified Infrastructure Management SaaS (Nimsoft / UIM)

Issue/Introduction

Upgrade failures in Test environment.

The first upgrade failure occurred at 15%.

2022-09-20 14:31:41,290 WARN  probe.ProbeController:waitForResponse:245 [Thread-37]  - nametoip failed: (4) not found, Received status (4) on response (for sendRcv) for cmd = 'nametoip' name = 'automated_deployment_engine'
2022-09-20 14:31:43,790 DEBUG pds.PDSController:send:177 [Thread-37]  - Sending 'nametoip' with sid: 5L..., timeout: 30000
message is then repeated

etc
etc

• It could have been that the customer removed java_jre 2.13 from the local archive (thinking it was 2.14 since the Web version displays '2.14') 
• CU3 should have installed only java_jre 2.13, not 2.14. 2.14 is the web version.
• Then the customer reran the UIM Server installer and it failed again but this time at 37%.

2022-09-20 14:36:41,787 ERROR probe.ProbeController:waitForResponse:256 [Thread-37]  - Failed to communicate with probe 'automated_deployment_engine' in the allotted time.
2022-09-20 14:36:41,787 ERROR impl.UIMServerConfigureController:run:482 [Thread-37]  - NimException caught
(6) permission denied, Failed to communicate with probe 'automated_deployment_engine' in the allotted time of 300 secs.
 at com.nimsoft.install.nimcommon.probe.ProbeController.waitForResponse(ProbeController.java:257)
 at com.nimsoft.install.uimserver.action.impl.UIMServerConfigureController.waitForProbeToRespondCommon(UIMServerConfigureController.java:3307)
 at com.nimsoft.install.uimserver.action.impl.UIMServerConfigureController.waitForProbeToRespondCommon(UIMServerConfigureController.java:3293)
 at com.nimsoft.install.uimserver.action.impl.UIMServerConfigureController.configureAde(UIMServerConfigureController.java:1441)
 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
 at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
 at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
 at java.lang.reflect.Method.invoke(Method.java:498)
 at com.nimsoft.install.nimcommon.method.NimMethodCallback.invokeMethod(NimMethodCallback.java:532)
 at com.nimsoft.install.nimcommon.method.NimMethodCallback.invokeMethod(NimMethodCallback.java:516)
 at com.nimsoft.install.uimserver.action.impl.UIMServerConfigureController.doConfigure_postNMSStartupPackages(UIMServerConfigureController.java:535)
 at com.nimsoft.install.uimserver.action.impl.UIMServerConfigureController.doConfigure(UIMServerConfigureController.java:496)
 at com.nimsoft.install.uimserver.action.impl.UIMServerConfigureController.run(UIMServerConfigureController.java:480)
 at java.lang.Thread.run(Thread.java:750)

Failure at 37% due to ADE not starting, then timing out.

Environment

• Release: 20.4 CU3
• Component: ade v20.43
• UIM 20.4 CU3, upgrading to 20.4 CU4 (20.4.4)
• ade v20.43
• java_jre 2.13
  
  

Local archive java_jre packages in place before upgrade are shown below - no changes made to the archive as shown below.

 

 

Checked Installed packages for java_jre version:

Cause

• ADE fails to start/restart successfully

Resolution

To resolve the upgrade issues we did the following:

1. Restarted ADE.
2. Reran UIM Server installer. Success.
3. We had to manually start the probes on the Primary hub since the installation was interrupted and left in that state (on purpose for proper analysis)
4. Ran OC installer.
5. Success.

Additional Information

Prior to installing UIM 20.4 CU4 (20.4.4), to ensure the upgrade to CU4 is successful, you can choose to remove all versions of java_jre from the archive before starting the installer. 

After the install of CU4, java_jre version 2.13 should be brought into the archive via the installer and not the newest version of java_jre, version 2.14.