"Failure Domain down" error in newly deployed Edge VM

Products

VMware NSX

Issue/Introduction

A newly deployed Edge VM had a controller status reported as disconnected, but has connectivity to all 3 NSX managers is UP.

_{edge-x> get controllers}
_{Thu Aug 21 2025 UTC 06:23:06.908}
_{Controller IP Port SSL Status Is Physical Master Session State Controller FQDN Failure Reason}
_{#.#.#.# 1235 enabled disconnected true down NA OTHER_ERROR}
_{#.#.#.# 1235 enabled not used false null NA NA}
_{#.#.#.# 1235 enabled not used false null NA NA}

_{edge-x> get managers}
_{Thu Aug 21 2025 UTC 06:23:01.609}
_{- #.#.#.# Connected (NSX-RPC) *}
_{- #.#.#.# Connected (NSX-RPC)}
_{- #.#.#.# Connected (NSX-RPC)}

The issue does not get resolved by deletion/redeploying the edge.

Environment

VMware NSX

Cause

The issue is caused by IP pool exhaustion.

Resolution

Expand the IP pool CIDR or delete unused edges to free up IPs.

Additional Information

The issue can be found in the NSX Manager NSXAPI log (/var/log/proton/nsxapi.log)

_{2025-08-21T05:27:20.166Z ERROR L2HostConfigTaskExecutor4 IPAMServiceImpl 81229 POOL-MGMT [nsx@6876 comp="nsx-manager" errorCode="MP5109" level="ERROR" subcomp="manager"] Insufficient Resource Exception : no free IP found to allocate from the pool IpPool/####-####-####-####.}
_{2025-08-21T05:27:20.166Z ERROR L2HostConfigTaskExecutor4 IPAMUtils 81229 FABRIC [nsx@6876 comp="nsx-manager" errorCode="MP8212" level="ERROR" subcomp="manager"] Failed to get a valid IP from IpPool IpPool/####-####-####-#### with cidr null, {}.}
_{com.vmware.nsx.management.common.exceptions.InsufficientResourcesException: null}
_{at com.vmware.nsx.management.idas.ipam.service.IPAMServiceImpl.allocate(IPAMServiceImpl.java:105) ~[?:?]}
_{at com.vmware.nsx.management.switching.sync.host.IPAMUtils.ufoAllocateIpFromPool(IPAMUtils.java:63) ~[?:?]}
_{at com.vmware.nsx.management.switching.sync.host.VtepPopulator.allocateResourcesToNewVteps(VtepPopulator.java:436) ~[?:?]}
_{at com.vmware.nsx.management.switching.sync.host.VtepPopulator.populateVtepsForHostSwitch(VtepPopulator.java:264) ~[?:?]}
_{at com.vmware.nsx.management.switching.sync.host.VtepPopulator.populateVtepsForHostSwitch(VtepPopulator.java:226) ~[?:?]}
_{at com.vmware.nsx.management.switching.sync.host.VtepPopulator.populateVtepForUpdatedHostSwitches(VtepPopulator.java:119) ~[?:?]}
_{at com.vmware.nsx.management.switching.sync.host.TransportNodeAsyncServiceImpl.stageSendingHostConfigMsg(TransportNodeAsyncServiceImpl.java:1248) ~[?:?]}
_{at com.vmware.nsx.management.switching.sync.host.TransportNodeAsyncServiceImpl.syncTransportNode(TransportNodeAsyncServiceImpl.java:3216) ~[?:?]}
_{at com.vmware.nsx.management.switching.sync.host.TransportNodeAsyncRequestHandler$TransportNodeConfigTask.run(TransportNodeAsyncRequestHandler.java:720) ~[?:?]}
_{at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[?:?]}
_{at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[?:?]}
_{at java.lang.Thread.run(Unknown Source) ~[?:?]}