NSX Manager upgrade fails during Data Migration steps with failure message "Unexpected error while upgrading upgrade unit: Data migration jar is not running"

Products

• VMware NSX

Issue/Introduction

• NSX is being upgraded to a version above 4.1 and below 4.2.2
• During one of several stages of the Data Migration Steps, the upgrade fails.
• Upgrade Details show Failed to the right of any of the Upgrade Units. Clicking on the word Failed will show the details which include the message:
  
  Unexpected error while upgrading upgrade unit: Data migration jar is not running.
  
  
• The below images shows examples of what is described above:
  
  
  
  
• Upgrade logs shows the following.
  
  /var/log/upgrade-coordinator/upgrade-coordinator.log
2023-11-14T11:14:51.835Z  INFO task-executor-0-workitem-MP-TraceflowStatusMigrationTask MPRollingUpgradeServiceImpl 3162 SYSTEM [nsx@6876 comp="nsx-manager" level="INFO" subcomp="upgrade-coordinator"] Data migration jar is not running
  
  
  
• The following output is observed on the NSX Manager in the logical migration logs. 
  
  /var/log/upgrade-coordinator/logical-migration.log
2025-02-24T05:40:33.275Z  INFO main InternalGroupOwnershipMigrationTask 156239 - [nsx@6876 comp="nsx-manager" level="INFO" subcomp="manager"] getting resource identifiers for table InternalGroup 2025-02-24T05:40:33.277Z  INFO main InternalGroupOwnershipMigrationTask 156239 - [nsx@6876 comp="nsx-manager" level="INFO" subcomp="manager"] Error in InternalGroupOwnershipMigrationTask
  ...
  2025-02-24T05:40:33.279Z  WARN main UfoCorfuTableMigrator 156239 - [nsx@6876 comp="nsx-manager" level="WARNING" subcomp="manager"] ERROR while running logical migration MappingDetails{name='InternalGroupOwnershipMigrationTask', runForTheseFromVersions='3.2,4.0', targetVersion='4.1', modelName='null', migrationType=null, reason='Add ownerId and Origin Site ID to internal group', customMigratorClassName='com.vmware.nsx.management.migration.impl.InternalGroupOwnershipMigrationTask', fieldMappings=null, targetProtoName='null', requiresCustomCode='false', owner='null', apiToTest='null', weight='1.0', impactedTables='InternalGroup', cleanup='false', enabled'false', diskBacked'false', triggerMode'null', supportsResolve'false', component'null'} java.lang.IllegalArgumentException: Please provide Key, Value & Metadata schemas to re-open this existing table InternalGroup in namespace nsx at    ...     at com.vmware.nsx.management.migration.impl.LogicalMigration.main(LogicalMigration.java:35) ~[logical-migration.jar:?]
  ...
  2025-02-24T05:40:33.280Z  WARN main ProgressMonitoring 156239 - [nsx@6876 comp="nsx-manager" level="WARNING" subcomp="manager"] Failed to read progress json. Re-creating file
  
  
  
• NOTE: This issue applies to versions above 4.1 and below 4.2.2. If you see similar issues on earlier versions please see KB 326173

Environment

VMware NSX 4.x

Resolution

This issue is resolved in VMware NSX 4.2.2, available at Broadcom downloads.

If you are having difficulty finding and downloading software, please review the Download Broadcom products and software KB.

Workaround:

If you believe you have encountered this issue, please open a support case with Broadcom Support and refer to this KB article.

For more information, see Creating and managing Broadcom support cases.