VMware NSX Edge upgrade fails on power on step post-upgrade due to the edge vnics getting disconnected on Edge virtual machine.

Products

• VMware Cloud Foundation
• VMware NSX Networking

Issue/Introduction

Symptoms:

• You are doing a VCF upgrade and the VMware edge upgrade fails.
• In the NSX-T manager log /var/log/upgrade/upgrade-coordinator.log we see the following message:

Edge group upgrade status is FAILED: [Edge 4.1.1.0.0.22224312/Edge/nub/VMware-NSX-edge-4.1.1.0.0.22224325.nub post power on task failed on edge TransportNode xxxxxxxx-d120-47e5-bc7c-xxxxxxxxxx: clientType EDGE, target edge fabric node id xxxxxxxx-d120-47e5-bc7c-xxxxxxxxxx, return status Issuing post_power_on failed to complete in time .].

• On the VCenter server edge, the edge node virtual machine's interfaces are found in a disconnected state.
• Edge node upgrade fails in post-upgrade power on task.

Note: The preceding log excerpts are only examples. Date, time, environmental variables and versions may vary depending on your environment.

Environment

VMware NSX-T Data Center 4.x
VMware NSX-T Data Center
VMware Cloud Foundation 5.0

Cause

Post upgrade, the edge node's network cards are in a disconnected state in vCenter.

Resolution

This is a known issue impacting VMware NSX.

Workaround:

• To workaround this issue, reconnect the network interfaces of the affected edge node virtual machine by logging into the vCentre server.
• Once the network interfaces are back up retry edge node upgrade either from the SDDC manager UI or via SDDC manager rest API.

Additional Information

Impact/Risks:
This issue will cause the Edge upgrade workflow to fail.