VCF Upgrade - Pre-Check Failures in NSX In-Place Upgrade for non-vLCM clusters
search cancel

VCF Upgrade - Pre-Check Failures in NSX In-Place Upgrade for non-vLCM clusters

book

Article ID: 378136

calendar_today

Updated On:

Products

VMware SDDC Manager

Issue/Introduction

NSX In-Place Upgrade pre-checks fail for one of the following reasons,

  • Insufficient Free memory which can lead to failure.
  • Service insertion is enabled.

Environment

Environments having a high scale which might lead to memory constraints.

In-place upgrade is selected

Cause

  • Insufficient Free memory which can lead to failure.

Pre-check name: Buddy stats check - Ensure sufficient read-only memory is available to dual load NSX VIBs. It checks if 2MB or higher buddy memory available.

# Buddy stats can be checked using the command below.

     - memstats -r buddy-stats

     * Sample Output *

 MEMMAP BUDDY STATS: Date - Time
 --------------------------------------------
   Selected columns : (all)

-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
                name memNode type numaNode memNodeTier    4KBfree    8KBfree   16KBfree   32KBfree   64KBfree  128KBfree  256KBfree  512KBfree    1MBfree    2MBfree    4MBfree    8MBfree   16MBfree   32MBfree   64MBfree  128MBfree  256MBfree  512MBfree    1GBfree
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
             buddy-0       0  low        0           0          1          1          0          1          1          1          1          1          1          1          1          2          2          2          2          2          2          2          0
             buddy-1       1  low        0           0          3          1          3          1          1          3          0          5          4          4          2          3          1          1          1          0          0          1          0
             buddy-2       2 high        0           0       5688       1898       1075       1115        543        122         44          1          1          1          0          0          1          1          0          1          0          0        417
             buddy-3       3 high        0           0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0

             buddy-4       4 high        1           0       5771       4080       1051        974        454        396        153          2          0          1          1          0          1          0          1          1          1          1        400
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
               Total                                        11463       5980       2129       2091        999        522        198          9          6          7          4          5          5          4          4          4          3          4        817
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

 

  • Service insertion is enabled.

Pre-check name: serviceInsertionCheck - SI configured on the host

Resolution

  • Insufficient Free memory which can lead to failure.

If the memstats command shows that the buddy memory blocks on each NUMA node do not have enough memory, please consider the options below. 

# Minimum Memory Requirements

- Below 4.2.2 - total 8 MB from each NUMA node.

- 4.2.2 or above - total 12 MB from any NUMA node.

 

Below are the two options:


           a) VMotion VMs out to free up memory space or reboot to defragment the memory.
           b) Change the upgrade mode to maintenance-mode then perform the upgrade.

 

  • Service insertion is enabled.

Disable SI firewall rules or use maintenance-mode upgrade.

Additional Information

Generally, pre-checks indicate any potential issues for the In-Place upgrade mode, it is suggested to proceed with the maintenance-mode upgrades for those domains