SE Groups upgrade is failing with this Error:"Available memory of SE is insufficient for performing the upgrade operation."

Products

• VMware Avi Load Balancer

Issue/Introduction

• When attempting to upgrade SE groups (non-admin tenant) on previous releases with a Controller on version 31.1.1, the upgrade will fail due to insufficient available memory on the Service Engines (SE).

Available memory of SE is insufficient for performing the upgrade operation.

Validating SE's in Default-Group/<segrp-uuid>
Failed to fetch SE Group info for <segrp-uuid>, Detailed Error: Encountered an error on GET request to URL https://localhost//api/serviceenginegroup/segrp-uuid: HTTP code: 404; error from Controller: map[error:ServiceEngineGroup object not found!]

Environment

• Avi Controller Version 31.1.1
• Avi SE group version 22.1.x ,30.2.x,30.1.x

Cause

• SeGroups from different tenants were not properly handled while retrieving SeGroup memory information via the API

Resolution

Workaround:

Login to Avi Controller via ssh and follow these steps:

[email protected]: sudo -i 

<Enter password>

• [email protected]: vi /opt/avi/etc/prechecks/must_checks_composite.yml 
• Move the "CheckSeAvailableMemory" from Mandatory_checks to skip_check:
  
  

  UpgradeSeGroupParamsCheck:
    mandatory_checks:
      - "CheckCluster"
      - "CheckControllerUpgradeOpsInProgress"
      - "CheckPerSeGroupInProgress"
      - "CheckSeErrorRecovery"
      - "CheckSeGroupCloudReady"
      - "CheckSeActiveVersions"
      - "CheckAviEssentialsMode"
      - "CheckCloudCompatibilitySeGroup"
      - "CheckSkipAllSeGroups"
      - "CheckSeUpgradeDiskSpace"
      - "CheckSePatch"
      - "CheckControllerDiskSpace"
      - "CheckVersionCompatibility"
      - "CheckImageVersion"
      - "CheckUpgradeImage"
      - "CheckSeLicense"
      - "CheckPatchPackage"
      - "CheckSeMemory"
      - "CheckCertificateExpiry"
      - "CheckLicenseConsumption"
    skip_checks:
      - "CheckBackup"
      - "CheckSeReachability"
      - "CheckSkipSeGroups"
      - "CheckUberWarning"
      - "CheckVsDisruption"
      - "CheckGslbManualResume"
      - "CheckSystemConfiguration"
      - "CheckTimeSync"
      - "CheckSeAvailableMemory"  <<<<<<<<<,

   

  Note: This change needs to be done on all three nodes in the case of Controller cluster.

 

Resolution:For permanent fix upgrade to this patch i.e 31.1.1-2p2

Fix version:31.1.1-2p2