SDDC manager repots "Failed to get network info" when trying to add host to the cluster.
search cancel

SDDC manager repots "Failed to get network info" when trying to add host to the cluster.

book

Article ID: 429364

calendar_today

Updated On:

Products

VMware SDDC Manager

Issue/Introduction

  • When attempting to add a host to a cluster via the SDDC Manager UI, the wizard fails at the switch configuration stage. The UI displays a "Failed to get network info. Http failure response for <NSX Manager>/ui/api/v1/clusters/network/queries/: 500 Internal Server Error"

 

  • Logs on SDDC Manager located at /var/log/vmware/vcf/domainmanager/domainmanger.log reports the following:

YYYY:MM:DDTHH:MM:SS DEBUG [vcf_dm,0000000000000000,0000] [c.v.v.c.n.s.c.c.ApiConnection,ForkJoinPool.commonPool-worker-124]  Creating ApiClient to https://<NSX-T-MANAGER>:443 with username admin
YYYY:MM:DDTHH:MM:SS DEBUG [vcf_dm,0000000000000000,0000] [c.v.v.c.n.s.c.c.ApiConnection,ForkJoinPool.commonPool-worker-124]  Created ApiClient connection to: m01nsxtmgry2.corp.ad.sbi
YYYY:MM:DDTHH:MM:SS ERROR [vcf_dm,0000000000000000,0000] [c.v.v.c.n.s.c.c.ComplexHelpers,ForkJoinPool.commonPool-worker-124]  Exception occurred during NSX API invocation
java.util.concurrent.ExecutionException: com.vmware.vapi.std.errors.Unauthorized: Unauthorized (com.vmware.vapi.std.errors.unauthorized) => {
    messages = [],
    data = struct => {error_message=The credentials were incorrect or the account specified has been locked., error_code=403, module_name=common-services},
    errorType = UNAUTHORIZED
}
        at java.base/java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:396)
        at java.base/java.util.concurrent.CompletableFuture.get(CompletableFuture.java:2073)
        at com.vmware.vapi.bindings.CompletionStageFuture.get(CompletionStageFuture.java:45)
        at com.vmware.vcf.common.nsxt.sdk.client.connection.ComplexHelpers.invoke(ComplexHelpers.java:188)
        at com.vmware.vcf.common.nsxt.sdk.client.connection.NodeVersionOperations.getVersion(NodeVersionOperations.java:26)
        at com.vmware.vcf.common.nsxt.sdk.client.connection.ApiConnection.preferPolicyOverMp(ApiConnection.java:539)
        at com.vmware.vcf.common.nsxt.sdk.client.connection.ApiConnection.initializeShim(ApiConnection.java:515)
        at com.vmware.vcf.common.nsxt.sdk.client.connection.NsxtConnectionFactory.initializeShim(NsxtConnectionFactory.java:108)
        at com.vmware.vcf.common.nsxt.sdk.client.connection.NsxtConnectionFactory.openManagerConnection(NsxtConnectionFactory.java:62)
        at com.vmware.vcf.common.nsxt.sdk.client.connection.NsxtConnectionFactory.openManagerConnection(NsxtConnectionFactory.java:51)
        at com.vmware.vcf.configreconciler.config.checks.ComputeManagerSettingsDriftCheck.isConfigurationRealized(ComputeManagerSettingsDriftCheck.java:129)
        at com.vmware.vcf.configreconciler.service.ResourceCacheService.performIsConfigRealizedCheck(ResourceCacheService.java:1014)
        at com.vmware.vcf.configreconciler.service.ResourceCacheService.refreshFailedConfigRealizedCheck(ResourceCacheService.java:1055)
        at com.vmware.vcf.configreconciler.service.ResourceCacheService.refreshConfigApplicability(ResourceCacheService.java:935)
        at com.vmware.vcf.configreconciler.service.ResourceCacheService.lambda$refreshLocalInventoryWithConfigApplicability$0(ResourceCacheService.java:264)
        at java.base/java.util.stream.ForEachOps$ForEachOp$OfRef.accept(ForEachOps.java:183)
        at java.base/java.util.concurrent.ConcurrentHashMap$KeySpliterator.forEachRemaining(ConcurrentHashMap.java:3573)
        at java.base/java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:509)
        at java.base/java.util.stream.ForEachOps$ForEachTask.compute(ForEachOps.java:290)
        at java.base/java.util.concurrent.CountedCompleter.exec(CountedCompleter.java:754)
        at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373)
        at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182)
        at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655)
        at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622)
        at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165)
Caused by: com.vmware.vapi.std.errors.Unauthorized: Unauthorized (com.vmware.vapi.std.errors.unauthorized) => {
    messages = [],
    data = struct => {error_message=The credentials were incorrect or the account specified has been locked., error_code=403, module_name=common-services},
    errorType = UNAUTHORIZED

  • The password management on the SDDC manager reports NSXT account, admin being disconnected. 

Environment

VCF 4.x 

VCF 5.x 

Cause

The issue may be caused by one of the following scenarios related to NSX-T Admin account:

  • Password Expired : The NSX admin password would have been expired before it can be updated from the SDDC manager. 
  • Out-of-band Change: The NSX-T admin password was changed outside of sddc manager, leading to mismatch of passwords between the SDDC manager and the NSX T appliance 
  • Account lockout : The admin account has been temporarily disabled due to multiple failed login attempts.

Resolution

To resolve the issue, reset the admin password to match the SDDC manager following kb Root user account is disconnected in SDDC Manager password management