Adding host to a workload domain cluster fails in SDDC manager with error "Failed to get network info. Http failure reposnse"

Products

• VMware SDDC Manager

Issue/Introduction

Issue: Adding a Host to a Workload Domain Cluster Fails in SDDC Manager

 

Cause

/var/log/vmware/vcf/domainmanager/domainmanager.log indicates a connectivity issue to the NSX-T cluster:

[YYYY-MM-DDThh:mm:ss.295+0000] ERROR [vcf_dm,66a9da3cbddf5766ce48e703582387ea,f682] [c.v.v.c.n.s.c.c.ComplexHelpers,dm-exec-19] Exception occurred during NSX API invocation java.util.concurrent.ExecutionException: com.vmware.vapi.client.exception.ConnectionException: No route to host at java.base/java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:396)

[YYYY-MM-DDThh:mm:ss.296+0000] ERROR [vcf_dm,66a9da3cbddf5766ce48e703582387ea,f682] [c.v.v.c.f.p.nsxt.helpers.NsxtUtils,dm-exec-19] Error fetching NSX cluster statuscom.vmware.vapi.client.exception.ConnectionException: No route to host

[YYYY-MM-DDThh:mm:ss.296+0000] ERROR [vcf_dm,66a9da3cbddf5766ce48e703582387ea,f682] [c.v.e.s.c.s.ClusterNetworkConfigFetcher,dm-exec-19] NSX-T cluster not reachable as its stability status is false

[YYYY-MM-DDThh:mm:ss.292+0000] ERROR [vcf_dm,66a9da3cd86905cc5ba63fb7dc269686,2eb1] [c.v.e.s.c.s.ClusterNetworkConfigQueryHelper,dm-exec-5] Failed to retrieve network configuration from vCenter and NSX-T for cluster, due to SDDC service exception com.vmware.evo.sddc.common.services.error.SddcManagerServicesIsException: NSX Cluster <FQDN> not reachable

Resolution

Troubleshooting Connectivity Between SDDC Manager and NSX-T Manager:

To resolve connectivity issues between the SDDC Manager and NSX-T Manager, perform the following steps:

1. Review Network Connectivity:

• Verify Network Configuration: Ensure both the SDDC Manager and NSX-T Manager have the correct network settings, including IP addresses, subnet masks, and default gateways.
• Test Network Connectivity: Use tools like ping or telnet to verify basic network connectivity between the SDDC Manager and NSX-T Manager.

2. Validate DNS Resolution:

• Check DNS Configuration: Confirm that the DNS server(s) configured on both the SDDC Manager and NSX-T Manager are properly set and functioning correctly. This might involve verifying the DNS server addresses, checking DNS settings in the operating system, and confirming DNS server availability.
• Perform DNS Lookups: From the SDDC Manager, execute a DNS lookup for the NSX-T Manager hostname. Verify that the returned IP address matches the actual IP address of the NSX-T Manager. If the DNS lookup fails or returns an incorrect IP address, it indicates a DNS resolution problem.

Note: If the DNS resolution is failing, troubleshoot the DNS configuration on both the SDDC Manager and NSX-T Manager. This might include checking the DNS settings on the network devices, verifying domain name records, and ensuring proper DNS server communication.