"Unable to connect to File /repository/4.2.1.3.0.24533884/UC/jre/upgrade-coordinator-tomcat-wrapper-jdk11.conf on source <Source-IP>", error on VMware NSX Upgrade coordinator

Products

• VMware NSX

Issue/Introduction

• Trying to upgrade to latest build, getting the following error:
  "Unable to connect to File /repository/4.2.1.3.0.24533884/UC/jre/upgrade-coordinator-tomcat-wrapper-jdk11.conf on source <Source-IP>. Please verify that file exists on source and install-upgrade service is up."
  
• On NSX Manager Upgrade coordinator Logs, we get the following:

  /var/log/upgrade-coordinator/upgrade-coordinator.log:
  2025-05-08T16:22:28.024Z  INFO NSXUcUpgradeService-3-1 UcRestClient 2256954 SYSTEM [nsx@6876 comp="nsx-manager" level="INFO" subcomp="upgrade-coordinator"] Sending GET request to api/v1/upgrade/summary

  2025-05-08T16:22:28.616Z  WARN NSXUcUpgradeService-3-1 NSXUcUpgradeStep 2256954 SYSTEM [nsx@6876 comp="nsx-manager" level="WARNING" subcomp="upgrade-coordinator"] Unable to execute Upgrade coordinator API on node ClusterNodeConfig{externalId='XXXXXXX-XXXX-XXXX-XXXX-XXXXXXXXXX', managerRole='ManagementClusterRoleConfig{apiListenAddr='ServiceEndpoint{ipAddress='XX.XX.XX.XX', ipv6Address='null', fqdn='null', ipv6Fqdn='null', port='443', certificate='-----BEGIN CERTIFICATE-----

Environment

VMware NSX

Cause

Update coordinator service is stuck as "not started".

Resolution

This is a condition that may occur in a VMware NSX environment.

Workaround: 

1. Get the output of the below API via Postman API:
   • Using API client (POSTMAN, Curl...) invoke a GET:
     GET: https://nsx IP/api/v1/upgrade/status-summary
   • Example output:
# curl -k -v -H "Content-Type:application/json" -u admin -X GET https://<NSXT-IP>/api/v1/upgrade/status-summary
"pre_upgrade_status" : {
      "status" : "NOT_STARTED",
      "failure_count" : 0,
      "warning_count" : 0,
     "error_count" : 0,
      "start_time" : 0,
      "end_time" : 0
    },
"can_rollback" : false
  } ]

2. Follow the steps below to restart the Upgrade-coordinator service:
   1. SSH to the NSX Manager as 'admin'. 
   2. To get orchestrator node IP address, run: 
      get service install-upgrade
   3. From the above output the IP you get is the "orchestrator node IP".
   4. SSH to that node as 'root'.
   5. Restart upgrade coordinator on the node with below command:
      service upgrade-coordinator restart
   6. Go back to UI and navigate to the upgrade section.
      
   7. Upload the upgrade bundle again.