Aria Operations for Networks fails upgrade for collector appliances with error message on GUI Node version mismatch detected
search cancel

Aria Operations for Networks fails upgrade for collector appliances with error message on GUI Node version mismatch detected

book

Article ID: 381536

calendar_today

Updated On:

Products

VMware Aria Operations for Networks

Issue/Introduction

Aria Operations for Networks fails upgrade for collector appliances with error message on GUI such as Node version mismatch detected is seen.

Screenshot from Aria Operations for Networks GUI in upgrade state as below:

Upgrade still shows in Progress for the collector appliances.

Disc Space on Aria Operations for Networks collector appliance shows 100% in use for /home partition as seen in output below:

ubuntu@aria-networks-collector:~$ df -h
Filesystem                    Size  Used Avail Use% Mounted on
udev                           12G     0   12G   0% /dev
tmpfs                         2.4G 1008K  2.4G   1% /run
/dev/mapper/vg-root            24G  7.4G   15G  34% /
tmpfs                          12G  8.0K   12G   1% /dev/shm
tmpfs                         5.0M     0  5.0M   0% /run/lock
none                           12G     0   12G   0% /run/shm
/dev/sda1                     1.9G   72M  1.7G   5% /boot
/dev/mapper/vg-tmp             17G  4.9G   11G  31% /tmp
/dev/mapper/vg-home            14G   14G     0 100% /home
/dev/mapper/vg-var             99G   37G   58G  39% /var
/dev/mapper/vg-var+log         28G  7.9G   19G  30% /var/log
/dev/mapper/vg-var+log+audit  9.3G   16M  8.8G   1% /var/log/audit
tmpfs                         2.4G     0  2.4G   0% /run/user/999
tmpfs                         2.4G     0  2.4G   0% /run/user/1002
tmpfs                         2.4G     0  2.4G   0% /run/user/1001
ubuntu@aria-networks-collector:~$

 

In this case this upgrade shows for Aria Operations for Networks 6.14.0 version, however this scenario can happen with any of the  Aria Operations for Networks versions.

 

Environment

VMware vRealize Network Insight 6.9
Aria Operations for Networks 6.10.0
Aria Operations for Networks 6.11.0
Aria Operations for Networks 6.12.0
Aria Operations for Networks 6.13.0
Aria Operations for Networks 6.14.0

Cause

 This issue is seen when disk space requirements for the the collector appliance is not met, which is 5 GB free.


Collector appliance disc space for /home needs to be evaluated and clean is needed.

Resolution

Execute below steps to perform the clean and to ensure the upgrade resumes post clean up of /home partition.

1. Initiate SSH/Putty session on the affected appliance.

2. Login using username support

3. Identify files taking up the space and  clean up using below command

support@aria-networks-collector:~$ ls -lrth
total 5.3G
-rw------- 1 root    root    249M Aug 28 07:23 nfcapd.202408280709
-rw------- 1 root    root    254M Aug 28 07:23 nfcapd.202408280710
-rw------- 1 root    root    248M Aug 28 07:23 nfcapd.202408280711
-rw------- 1 root    root    246M Aug 28 07:23 nfcapd.202408280712
-rw------- 1 root    root    246M Aug 28 07:23 nfcapd.202408280713
-rw------- 1 root    root    249M Aug 28 07:23 nfcapd.202408280714
-rw------- 1 root    root    251M Aug 28 07:23 nfcapd.202408280715
-rw------- 1 root    root    248M Aug 28 07:23 nfcapd.202408280716
-rw------- 1 root    root    242M Aug 28 07:23 nfcapd.202408280717
-rw------- 1 root    root    248M Aug 28 07:23 nfcapd.202408280718
-rwxrwxrwx 1 support support 2.7G Aug 28 07:26 logs_28th_August.tar
support@aria-networks-collector:~ ub
ubuntu@aria-networks-collector:~$ sudo rm -rf nfcapd.2024082807*
ubuntu@aria-networks-collector:~$ sudo rm -rf nfcapd.2024082807*

As you can see in above the over all space is consumed by nfcapd files and another tar file which we need to clean up.

4. Run below command to validate  appliance disc space for /home is > 5GB requirements and meets the upgrade prerequisites

ubuntu@aria-networks-collector:~$ df -h
Filesystem                    Size  Used Avail Use% Mounted on
udev                           12G     0   12G   0% /dev
tmpfs                         2.4G 1008K  2.4G   1% /run
/dev/mapper/vg-root            24G  7.4G   15G  34% /
tmpfs                          12G  8.0K   12G   1% /dev/shm
tmpfs                         5.0M     0  5.0M   0% /run/lock
none                           12G     0   12G   0% /run/shm
/dev/sda1                     1.9G   72M  1.7G   5% /boot
/dev/mapper/vg-tmp             17G  918M   15G   6% /tmp
/dev/mapper/vg-home            14G  8.0G  5.3G  61% /home
/dev/mapper/vg-var             99G   36G   59G  38% /var
/dev/mapper/vg-var+log         28G  7.9G   19G  30% /var/log
/dev/mapper/vg-var+log+audit  9.3G   16M  8.8G   1% /var/log/audit
tmpfs                         2.4G     0  2.4G   0% /run/user/999
tmpfs                         2.4G     0  2.4G   0% /run/user/1002
tmpfs                         2.4G     0  2.4G   0% /run/user/1001

In above output you can see that now /home partition shows 5.3 G as available.

5. Post executing above command the upgrade should resume and progress further. It may take up to 30 to 45 minutes to complete and till then the GUI is expected to show the  error message i.e. Node version mismatch detected.

6. You can tail the latest.log file of the launcher logs to see the progress using command below:

ubuntu@aria-networks-collector:/var/log/arkin/launcher$ tail -f latest.log 

7.  Upgrade should finish after 30 to 45 minutes and GUI should show you Done. See below screenshot.

8. Click on Done.

9. Login back to GUI and the error message should be gone as upgrade has successfully completed for the affected appliances in question.

10. Aria Operation for Networks GUI should show upgrade Version and error message should not be there post login, see screenshots below:

   

Additional Information

Post upgrade is you see Lags on GUI, then  these are expected and should clear after couple of hours.