NSX upgrade failing on SDDC Manager : "NSX Upgrade Coordinator could not be fetched"

Products

• VMware SDDC Manager / VCF Installer

Issue/Introduction

Issue occurs when the SDDC Manager attempts to query the upgrade status from the NSX-T Orchestrator node but fails to establish a valid connection object.

 

 

Environment

VMware Cloud Foundation 9.x

Cause

Unable to gather the NSX VIP address which are deployed outside SDDC Manager. 

 

error_message : Cannot invoke "com.vmware.vcf.common.nsxt.sdk.client.connection.NsxtManagerConnection.getUpgradeOperations()" because the return value of
com.vmware.evo.sddc.lcm.primitive.impl.nsxt.NsxtUpgradeUtil.getNsxtMangerOrchestratorUcConnection(com.vmware.evo.sddc.lcm.model.internal.nsxt.NsxtCluster)" is null, httpStatus:, error_code: 0

 

If more than one NSX appliance is manually added outside of SDDC Manager, it will not be recognized by SDDC Manager and may disrupt lifecycle operations.

 

026-02-17T15:03:03.003+0000 ERROR [vcf lcm, 699483256ee14b899ff51f8f62f1fd87,c2f8,auditId=febfdc47-fa2f-44b7-8f17-288121cf3b19,reso
rceType=NSX T MANAGER, resourceId=nsxmgr. vcf. local, name=nsxmgr. vcf. local] [c. v.e.s. l.p. i.nsxt. NsxtUpgradeUtil, Scheduled-3] Handling
NSX Exception
om. vmware. evo. sddc. lcm. model. error. LcmException: Failed to load NSX Cluster from the Inventory
at com. vmware. evo. sddc. lcm. primitive. impl. nsxt. NsxtInventoryLoader. loadNsxtInventory (NsxtInventoryLoader . java : 95)
at com. vmware. evo. sddc. lcm.primitive. impl. nsxt. NsxtAuditImpl. doAudit (NsxtAuditImpl. java: 87)
at com. vmware. evo. sddc. lcm. audit. NsxtAuditService. doAudit (NsxtAuditService. java: 134)
at com. vmware. evo. sddc. lcm. audit. NsxtInventoryAuditScheduler. auditNsxtInventoryTask (NsxtInventoryAuditScheduler . java : 82)
at com. vmware. evo. sddc. lcm. audit. NsxtInventoryAuditScheduler. processTask (NsxtInventoryAuditScheduler. java : 100)
at com. vmware. evo. sddc. lcm.model. task. AbstractLcmControllableScheduledTask. recieveMessage (AbstractLcmControllableScheduledT
sk . java: 55)
at jdk. internal. reflect. GeneratedMethodAccessor211. invoke (Unknown Source)
at java.base/jdk. internal. reflect.DelegatingMethodAccessorImpl. invoke (DelegatingMethodAccessorImpl. java: 43)
at java.base/java. lang. reflect.Method. invoke (Method. java:569)
at com. google. common. eventbus. Subscriber. invokeSubscriberMethod (Subscriber. java: 85)
at com. google. common. eventbus. Subscriber$SynchronizedSubscriber. invokeSubscriberMethod (Subscriber. java: 142)
com. google. common. eventbus.Subscriber.lambda$dispatchEvent$0 (Subscriber. java: 71)

at java.base/java. util.concurrent. ThreadPoolExecutor$Worker.run (ThreadPoolExecutor. java: 635)
at java.base/java. lang. Thread. run (Thread. java: 840)
Caused by: java. lang. RuntimeException: NSX Upgrade Coordinator could not be fetched
at com. vmware. evo. sddc. lcm. adapter. inventory. impl. InventoryClientImpl. getNsxtUcConnection (InventoryClientImpl. java: 2016)
at java.base/jdk. internal.reflect.NativeMethodAccessorImpl. invoke0 (Native Method)
at java.base/jdk. internal. reflect.NativeMethodAccessorImpl. invoke (NativeMethodAccessorImpl. java: 77)
at java.base/jdk. internal.reflect.DelegatingMethodAccessorImpl. invoke (DelegatingMethodAccessorImpl. java: 43)
at java.base/java. lang. reflect.Method. invoke (Method. java: 569)
at org. springframework. aop. support. AopUtils. invokeJoinpointUsingReflection (AopUtils. java:344)
at org. springframework. aop. framework. CglibAopProxy$DynamicAdvisedInterceptor. intercept (CglibAopProxy. java: 706)
at com. vmware. evo. sddc. lcm. adapter. inventory. impl. InventoryClientImpl$$SpringCGLIB$$0. getNsxtUcConnection (<generated>)
at com. vmware. evo. sddc. lcm.primitive. impl.nsxt. NsxtInventoryLoader. loadNsxtComponents(NsxtInventoryLdetjva8373)
at com. vmware. evo. sddc. lcm.primitive. impl. nsxt. NsxtInventoryLoader. loadNsxtInventory (NsxtInventoryLoade eava: 88) WiRd8ws
54 common frames omitted

Resolution

Delete the NSX Managers that were deployed outside of SDDC Manager, then redeploy them through SDDC Manager and retry the workflow.