Upgrade of NSX fails with "Unexpected error while upgrading upgrade unit: Data migration jar is not running"

Products

• VMware NSX

Issue/Introduction

• NSX is being upgraded to a version above 4.1 and below 4.2.2.
• During one of several stages of the Data Migration Steps, the upgrade fails.
• Upgrade Details show Failed to the right of any of the Upgrade Units. Clicking on the word Failed will show the details which include the message:
  Unexpected error while upgrading upgrade unit: Data migration jar is not running.
  
  
• The below images shows examples of what is described above:
  
  
  
  
• Upgrade logs shows the following.
  /var/log/upgrade-coordinator/upgrade-coordinator.log
INFO task-executor-0-workitem-MP-TraceflowStatusMigrationTask MPRollingUpgradeServiceImpl 3162 SYSTEM [nsx@6876 comp="nsx-manager" level="INFO" subcomp="upgrade-coordinator"] Data migration jar is not running
  
  
• The following output is observed on the NSX Manager in the logical migration logs. 
  /var/log/upgrade-coordinator/logical-migration.log
INFO main InternalGroupOwnershipMigrationTask 156239 - [nsx@6876 comp="nsx-manager" level="INFO" subcomp="manager"] getting resource identifiers for table InternalGroup 2025-02-24T05:40:33.277Z  INFO main InternalGroupOwnershipMigrationTask 156239 - [nsx@6876 comp="nsx-manager" level="INFO" subcomp="manager"] Error in InternalGroupOwnershipMigrationTask
  ...
  WARN main UfoCorfuTableMigrator 156239 - [nsx@6876 comp="nsx-manager" level="WARNING" subcomp="manager"] ERROR while running logical migration MappingDetails{name='InternalGroupOwnershipMigrationTask', runForTheseFromVersions='3.2,4.0', targetVersion='4.1', modelName='null', migrationType=null, reason='Add ownerId and Origin Site ID to internal group', customMigratorClassName='com.vmware.nsx.management.migration.impl.InternalGroupOwnershipMigrationTask', fieldMappings=null, targetProtoName='null', requiresCustomCode='false', owner='null', apiToTest='null', weight='1.0', impactedTables='InternalGroup', cleanup='false', enabled'false', diskBacked'false', triggerMode'null', supportsResolve'false', component'null'} java.lang.IllegalArgumentException: Please provide Key, Value & Metadata schemas to re-open this existing table InternalGroup in namespace nsx at    ...     at com.vmware.nsx.management.migration.impl.LogicalMigration.main(LogicalMigration.java:35) ~[logical-migration.jar:?]
  ...
  WARN main ProgressMonitoring 156239 - [nsx@6876 comp="nsx-manager" level="WARNING" subcomp="manager"] Failed to read progress json. Re-creating file
  
  

NOTE: This issue applies to versions above 4.1 and below 4.2.2. If you see similar issues on earlier versions please see KB 326173

Environment

VMware NSX

Resolution

This issue is resolved in VMware NSX 4.2.2, available at Broadcom downloads.

If you are having difficulty finding and downloading software, please review Download Broadcom products and software.

Workaround:

If you believe you have encountered this issue, please open a support case with Broadcom Support and refer to this KB article.

For more information, see Creating and managing Broadcom support cases.

Additional Information

Also see KB articles: 

• Unexpected error while upgrading upgrade unit: Data migration jar is not running error observed upgrade of NSX in step Data Migration
• NSX Manager upgrade fails during Data Migration steps with failure message "Unexpected error while upgrading upgrade unit: Data migration jar is not running"