Repeated upgrade to NSX-T Data Center 3.1.0 fails

Products

• VMware NSX

Issue/Introduction

• Repeated upgrade to NSX-T Data Center 3.1.0 fails.
• In the /var/run/log/esxupdate.log file of the ESXi host, you see entries similar to:
  
  Unexpected error while upgrading upgrade unit: Install of offline bundle failed on host ########-####-####-####-############ with error : [LiveInstallationError] Error in running ['/etc/init.d/nsx-datapath-dl', 'start', 'upgrade']: Return code: 1 Output: start upgrade begin Exception: Traceback (most recent call last): File "/etc/init.d/nsx-datapath-dl", line 1029, in <module> DualLoadUpgrade() File "/etc/init.d/nsx-datapath-dl", line 854, in DualLoadUpgrade LoadKernelModules() File "/etc/init.d/nsx-datapath-dl", line 205, in LoadKernelModules nsxesxutils.loadModule(modName) File "/usr/lib/vmware/nsx-esx-datapath/lib/python3.5/nsxesxutils.py", line 452, in loadModule linkModPath(moduleName) File "/usr/lib/vmware/nsx-esx-datapath/lib/python3.5/nsxesxutils.py", line 418, in linkModPath os.symlink(moduleName, link) FileExistsError: [Errno 17] File exists: '/usr/lib/vmware/vmkmod/nsx-esx-70/nsxt-core-17087530' -> '/usr/lib/vmware/vmkmod/nsxt-core-17087530' It is not safe to continue. Please reboot the host immediately to discard the unfinished update. Please refer to the log file for more details..

Environment

VMware NSX-T Data Center 3.x

Cause

This issue occurs because the symlinks were not removed in the NSX kernel module unload code during upgrade.

Resolution

This issue is resolved in VMware NSX-T Data Center 3.1.1, available at Broadcom downloads.

If you are having difficulty finding and downloading software, please review the Download Broadcom products and software KB.

Workaround:

1. Verify if the symlinks exist before doing an upgrade by running this command:
    
   ls -lht /usr/lib/vmware/vmkmod/nsxt-*
    
2. Remove the existing symlinks by running this command:
   
   rm -rf /usr/lib/vmware/vmkmod/nsxt-*
    
3. Verify if the symlinks have been removed by running this command:
   
   ls -lht /usr/lib/vmware/vmkmod/nsxt-*
    
4. Retry the upgrade operation again.