Storage vMotion fails with "Failed to attach all ports" when NSX Manager service "manager" is down

Products

• VMware NSX

Issue/Introduction

Symptoms:

• User tries to perform virtual machine Storage vMotion in vCenter GUI, however, it failed with error "An error occurred during host configuration: Failed to attach all ports".
• VM uses NSX segment.
• vCenter vpxd.log has error below:

YYYY-MM-DDTHH:MM:SS info vpxd[xxxxxx] [Originator@6876 sub=vmomi.soapStub[8015] opID=xxxxxx-xxxxxx-xxxxxx] SOAP request returne
d HTTP failure; <<io_obj p:xxxxxx, h:111, <UNIX ''>, <UNIX '/var/run/envoy-hgw/hgw-pipe'>>, /hgw/host-xxx/vpxa>, method: initiateDestination; c
ode: 500(Internal Server Error); fault: (vmodl.fault.SystemError) {
--> faultCause = (vim.fault.PlatformConfigFault) {
--> faultCause = (vmodl.MethodFault) null,
--> faultMessage = <unset>,
--> text = "Failed to attach all ports"
--> msg = "An error occurred during host configuration: Failed to attach all ports."
--> },
--> faultMessage = <unset>,
--> reason = "Undeclared fault"
--> msg = "Received SOAP response fault from [<<io_obj p:xxxxxx, h:111, <UNIX ''>, <UNIX '/var/run/envoy-hgw/hgw-pipe'>>, /hgw/host-xxx/vpxa>]: initiateDestination
--> Received SOAP response fault from [<<io_obj p:xxxxxx, h:21, <TCP '127.0.0.1 : 10059'>, <TCP '127.0.0.1 : 8307'>>, /sdk>]: initiateDestination
--> Method vim.host.VMotionManager.initiateDestination threw undeclared fault of type vim.fault.PlatformConfigFault"
--> }

• ESXi hostd.log has error below:

YYYY-MM-DDTHH:MM:SS Er(163) Hostd[525611]: [Originator@6876 sub=Vmsvc.vm:/vmfs/volumes/xxxxxx-xxxxxx-xxxxxx/<VM name>/<VM name>.vmx opID=xxxxxx-xxxxxx-xxxxxx sid=xxxxxx user=vpxuser:xxxxxx\Administrator] ProcessOpaqueNetChanges: Failed to attach all ports

• ESXi nsx-syslog.log has error below:

YYYY-MM-DDTHH:MM:SS Er(179) nsx-opsagent[526535]: NSX 526535 - [nsx@6876 comp="nsx-esx" subcomp="opsagent" s2comp="ctxteng" tid="xxxxxx" level="ERROR" errorCode="CTX251"] CtxtChannel: Failed to send message to NSX Manager, error: -1

• NSX Manager service "manager" is down when check with command "get cluster status":

Group Type: MANAGER
Group Status: UNAVAILABLE

Members:
    UUID                                       FQDN                                       IP               IPv6                                             STATUS
    xxxxxx-xxxxxx-xxxxxx                       <NSX manager FQDN>                         <NSX manager IP>  -                                                DOWN
    xxxxxx-xxxxxx-xxxxxx                       <NSX manager FQDN>                         <NSX manager IP>  -                                                DOWN
    xxxxxx-xxxxxx-xxxxxx                       <NSX manager FQDN>                         <NSX manager IP>  -                                                DOWN

 

 

Environment

VMware vSphere 8

VMware NSX 4

Cause

NSX Manager service "manager" is down which leads to Storage vMotion failure.

Resolution

Address the NSX Manager service "manager" outage by starting the 'manager' service with command "start service manager", then perform Storage vMotion.