NSX-T Edge Node upgrade can not be started with error "The value VERSION_UNKNOWN for version format is invalid"

Products

• VMware NSX

Issue/Introduction

Symptoms:

• Upgrade of an NSX-T Edge Node orchestrated by NSX-T Upgrade Coordinator will not start.
• Upgrade fails with error similar to:

Sep 16, 2020, 2:30:19 PM : Upgrade continue operation failed: [UC] Error in rest call. url= /nsxapi/api/v1/upgrade/version-whitelist/EDGE , method= PUT , response= { "httpStatus" : "BAD_REQUEST", "error_code" : 220, "module_name" : "common-services", "error_message" : "The value VERSION_UNKNOWN for version format is invalid. Valid value should be ....." } , error= 400 : [{ "httpStatus" : "BAD_REQUEST", "error_code" : 220, "module_name" : "common-services", "error_message" : "The value VERSION_UNKNOWN for version format is invalid. Valid value should be ....." }] .

• The NSX-T manager Upgrade Coordinator logs (/var/log/upgrade-coordinator/upgrade-coordinator.log) will show entries similar to:

2021-06-08T20:06:54.793Z INFO http-nio-127.0.0.1-7442-exec-4 ApplianceQueryServiceImpl - SYSTEM [nsx@6876 comp="nsx-manager" level="INFO" subcomp="upgrade-coordinator"] Setting version whitelist to VERSION_UNKNOWN 3.0.3.0.0.17778537

2021-06-08T20:06:54.793Z INFO http-nio-127.0.0.1-7442-exec-4 UcRestClient - SYSTEM [nsx@6876 comp="nsx-manager" level="INFO" subcomp="upgrade-coordinator"] Sending PUT request to nsxapi/api/v1/upgrade/version-whitelist/EDGE

2021-06-08T20:06:54.798Z INFO http-nio-127.0.0.1-7442-exec-4 LoggingRestTemplate - SYSTEM [nsx@6876 comp="nsx-manager" level="INFO" subcomp="upgrade-coordinator"] Request::URI:<NSX Manager hostname>/nsxapi/api/v1/upgrade/version-whitelist/EDGEmethod method:PUT

2021-06-08T20:06:54.798Z INFO http-nio-127.0.0.1-7442-exec-4 LoggingRestTemplate - SYSTEM [nsx@6876 comp="nsx-manager" level="INFO" subcomp="upgrade-coordinator"] Request body :{"acceptable_versions":["VERSION_UNKNOWN","3.0.3.0.0.17778537"],"_protection":"UNKNOWN","_revision":52}

2021-06-08T20:06:54.834Z INFO http-nio-127.0.0.1-7442-exec-4 UpgradeServiceImpl - SYSTEM [nsx@6876 comp="nsx-manager" level="INFO" subcomp="upgrade-coordinator"] Setting current upgrade status as PAUSED

2021-06-08T20:06:54.834Z ERROR http-nio-127.0.0.1-7442-exec-4 UpgradeServiceImpl - SYSTEM [nsx@6876 comp="nsx-manager" errorCode="MP30078" level="ERROR" subcomp="upgrade-coordinator"] Error while starting the upgrade for component EDGE

com.vmware.nsx.management.upgrade.rpcframework.UcRestRpcException: org.springframework.web.client.HttpClientErrorException$BadRequest: 400 : [{

"httpStatus" : "BAD_REQUEST",

"error_code" : 220,

"module_name" : "common-services",

"error_message" : "The value VERSION_UNKNOWN for version format is invalid. Valid value should be <major>.<minor>.<maintenance>.<patch>.<suffix>.<build-number>"

}]

...

Caused by: org.springframework.web.client.HttpClientErrorException$BadRequest: 400 : [{

"httpStatus" : "BAD_REQUEST",

"error_code" : 220,

"module_name" : "common-services",

"error_message" : "The value VERSION_UNKNOWN for version format is invalid. Valid value should be <major>.<minor>.<maintenance>.<patch>.<suffix>.<build-number>"

}]

Environment

VMware NSX-T Data Center

Resolution

This issue has been resolved in NSX-T 2.5.2 and 3.x.

Workaround:
To workaround this issue and continue the upgrade:

• Identify the NSX manager which the Upgrade coordinator is running on, to do this as admin run the following command, the result will be the IP address of the manager it is running on:

 get service install-upgrade

• SSH to the NSX manager that has a role of Upgrade Coordinator and as admin run the following command.

restart install-upgrade service

• Once the command is completed, you can resume the upgrade.