Aria Operations for Networks fails upgrade for collector appliances with error message on GUI such as Node version mismatch detected is seen.
Screenshot from Aria Operations for Networks GUI in upgrade state as below:
Upgrade still shows in Progress for the collector appliances.
Disc Space on Aria Operations for Networks collector appliance shows 100% in use for /home partition as seen in output below:
ubuntu@aria-networks-collector:~$ df -h
Filesystem Size Used Avail Use% Mounted on
udev 12G 0 12G 0% /dev
tmpfs 2.4G 1008K 2.4G 1% /run
/dev/mapper/vg-root 24G 7.4G 15G 34% /
tmpfs 12G 8.0K 12G 1% /dev/shm
tmpfs 5.0M 0 5.0M 0% /run/lock
none 12G 0 12G 0% /run/shm
/dev/sda1 1.9G 72M 1.7G 5% /boot
/dev/mapper/vg-tmp 17G 4.9G 11G 31% /tmp
/dev/mapper/vg-home 14G 14G 0 100% /home
/dev/mapper/vg-var 99G 37G 58G 39% /var
/dev/mapper/vg-var+log 28G 7.9G 19G 30% /var/log
/dev/mapper/vg-var+log+audit 9.3G 16M 8.8G 1% /var/log/audit
tmpfs 2.4G 0 2.4G 0% /run/user/999
tmpfs 2.4G 0 2.4G 0% /run/user/1002
tmpfs 2.4G 0 2.4G 0% /run/user/1001
ubuntu@aria-networks-collector:~$
In this case this upgrade shows for Aria Operations for Networks 6.14.0 version, however this scenario can happen with any of the Aria Operations for Networks versions.
VMware vRealize Network Insight 6.9
Aria Operations for Networks 6.10.0
Aria Operations for Networks 6.11.0
Aria Operations for Networks 6.12.0
Aria Operations for Networks 6.13.0
Aria Operations for Networks 6.14.0
This issue is seen when disk space requirements for the the collector appliance is not met, which is 5 GB free.
Collector appliance disc space for /home needs to be evaluated and clean is needed.
Execute below steps to perform the clean and to ensure the upgrade resumes post clean up of /home partition.
1. Initiate SSH/Putty session on the affected appliance.
2. Login using username support
3. Identify files taking up the space and clean up using below command
support@aria-networks-collector:~$ ls -lrth
total 5.3G
-rw------- 1 root root 249M Aug 28 07:23 nfcapd.202408280709
-rw------- 1 root root 254M Aug 28 07:23 nfcapd.202408280710
-rw------- 1 root root 248M Aug 28 07:23 nfcapd.202408280711
-rw------- 1 root root 246M Aug 28 07:23 nfcapd.202408280712
-rw------- 1 root root 246M Aug 28 07:23 nfcapd.202408280713
-rw------- 1 root root 249M Aug 28 07:23 nfcapd.202408280714
-rw------- 1 root root 251M Aug 28 07:23 nfcapd.202408280715
-rw------- 1 root root 248M Aug 28 07:23 nfcapd.202408280716
-rw------- 1 root root 242M Aug 28 07:23 nfcapd.202408280717
-rw------- 1 root root 248M Aug 28 07:23 nfcapd.202408280718
-rwxrwxrwx 1 support support 2.7G Aug 28 07:26 logs_28th_August.tar
support@aria-networks-collector:~ ub
ubuntu@aria-networks-collector:~$ sudo rm -rf nfcapd.2024082807*
ubuntu@aria-networks-collector:~$ sudo rm -rf nfcapd.2024082807*
As you can see in above the over all space is consumed by nfcapd
files and another tar file which we need to clean up.
4. Run below command to validate appliance disc space for /home is > 5GB requirements and meets the upgrade prerequisites
ubuntu@aria-networks-collector:~$ df -h
Filesystem Size Used Avail Use% Mounted on
udev 12G 0 12G 0% /dev
tmpfs 2.4G 1008K 2.4G 1% /run
/dev/mapper/vg-root 24G 7.4G 15G 34% /
tmpfs 12G 8.0K 12G 1% /dev/shm
tmpfs 5.0M 0 5.0M 0% /run/lock
none 12G 0 12G 0% /run/shm
/dev/sda1 1.9G 72M 1.7G 5% /boot
/dev/mapper/vg-tmp 17G 918M 15G 6% /tmp
/dev/mapper/vg-home 14G 8.0G 5.3G 61% /home
/dev/mapper/vg-var 99G 36G 59G 38% /var
/dev/mapper/vg-var+log 28G 7.9G 19G 30% /var/log
/dev/mapper/vg-var+log+audit 9.3G 16M 8.8G 1% /var/log/audit
tmpfs 2.4G 0 2.4G 0% /run/user/999
tmpfs 2.4G 0 2.4G 0% /run/user/1002
tmpfs 2.4G 0 2.4G 0% /run/user/1001
In above output you can see that now /home partition shows 5.3 G as available.
5. Post executing above command the upgrade should resume and progress further. It may take up to 30 to 45 minutes to complete and till then the GUI is expected to show the error message i.e. Node version mismatch detected.
6. You can tail the latest.log file of the launcher logs to see the progress using command below:
ubuntu@aria-networks-collector:/var/log/arkin/launcher$ tail -f latest.log
7. Upgrade should finish after 30 to 45 minutes and GUI should show you Done. See below screenshot.
8. Click on Done.
9. Login back to GUI and the error message should be gone as upgrade has successfully completed for the affected appliances in question.
10. Aria Operation for Networks GUI should show upgrade Version and error message should not be there post login, see screenshots below:
Post upgrade is you see Lags on GUI, then these are expected and should clear after couple of hours.