Infrastructure Manager (IM) and nas is very slow to respond

Products

• DX Unified Infrastructure Management (Nimsoft / UIM)
• CA Unified Infrastructure Management On-Premise (Nimsoft / UIM)
• CA Unified Infrastructure Management SaaS (Nimsoft / UIM)

Issue/Introduction

IM was very unresponsive. It seemed to stay in a 'hung' state. Hour-glassing effect noticed. Alarm messages flashing fast updates in the alarm console.

Note that it may also take a long time to open up but that can be due to the number of nodes (hubs and robots) its trying to refresh/display.

Checking the IM messages via View->Messages, or checking the nimbus_manager.log the IM showed a get_info probe callback communication error/timeout.

Jun 30 09:49:45:097 [8744] Infrastructure Manager: Warning - Request (get_info) has timed out (timeout interval: 4 sec)
Jun 30 09:49:45:098 [8744] Infrastructure Manager: get_info - nas - communication error

or

Jun 30 09:04:02:089 [8532] Infrastructure Manager: Warning - Request (get_info) has timed out (timeout interval: 10 sec)
Jun 30 09:04:02:089 [8532] Infrastructure Manager: get_info - /<domain>/<hub>/<robot>/nas - communication error

Environment

• Release: UIM 20.3 or higher
• Component: nas 9.31

Resolution

1. Click the "Hold Alarms" button in the alarm sub console so you can work more easily with the IM without delay/hour-glassing/hourglass effects. Note that you may have to allow it to catch up and normalize before you can start working with the IM again. This may take up to 10 minutes depending on alarm traffic/volume and the number of robots/nodes in your environment.

    You can also press the Hold alarms 'stoplight' button.

2. Open the nas GUI and select the Status Tab window

3. Rt-click and choose Advanced->Reorganize nas alarm database.

    Wait until its done - you can check the nas.log:

    (You may see messages similar to "nas: NAS is reorganizing database, the request ('set_visible') is denied." This is normal. It just indicates that nas is still reorganizing database and it cannot work on the request mentioned in the message.)

4. Via Raw configure - set nas bulk_read_size to 100.

5. Once completed re-enable the live alarm refresh by deselecting the "Hold Alarms" button.

     IM should then be more responsive with no further 'significant' delays.

     Note that you can also temporarily disable "Attempt Internet archive integration" to speed up IM's response.

• On installations where this web connection can not be established (e.g., due to firewall configurations), a timeout (and an error message) will appear each time the Infrastructure Manager application is started. Disable this option to avoid this timeout

• Note that any changes made while the IM is not responding may take some time to take effect

• Note that the IM "probe Request" timeout value can also be adjusted if you notice IM Messages in the alarm sub-console Messages window related to timing out

• Also, keep in mind that you should not have any alarms hitting the IM over and over again needlessly. If you check the alarm count for an alarm and its very high e.g., 11,000 - its a good candidate for either a change in threshold so you don't get flooded with unnecessary alarms or it is time for a pre-processing rule to exclude the alarm if it's just 'noise' and the alarm cannot currently be avoided/eradicated at its source.

6. Also, navigate to the installation directory...<drive>\Users\uim_admin1\AppData\Local\Temp\util and delete all of the nas conf_nas*.exe files, then restart the nas.