VMs on extended network lose gateway connectivity after service mesh upgrade

Products

• VMware HCX

Issue/Introduction

After completing a service mesh upgrade, virtual machines on an extended network are unable to route to their gateway.

The following symptoms are observed:

• VMs on the affected extended network cannot reach their gateway
• The gateway is located on the connector (on-premises) side of the connection
• The problematic VMs are on the cloud side of the connection
• Local on-premises machines can successfully reach the gateway
• Cloud-to-on-premises traffic fails while on-premises-to-on-premises traffic works normally
• Disabling network monitoring (MON) does not resolve the connectivity issue

Environment

• Service Mesh (all versions susceptible during upgrade)
• Extended network configurations with cloud and on-premises connectivity
• Virtual machines deployed across hybrid cloud environments

Cause

The network extension state becomes inconsistent during the service mesh upgrade process, causing a corruption in the routing configuration between the cloud and on-premises segments of the extended network. This affects the network extension connectivity layer specifically for cloud-to-on-premises traffic.

Resolution

To resolve the gateway connectivity issue for VMs on the affected extended network:

1. Identify the specific extended network experiencing routing issues
2. Document the current network configuration for reference
3. Unextend the affected network:
   • Navigate to the network extension management interface
   • Select the problematic extended network
   • Choose the option to unextend the network
   • Wait for the unextension process to complete
4. Re-extend the network:
   • Select the same network for extension
   • Apply the original configuration settings
   • Complete the network extension process
5. Verify connectivity:
   • Test VM connectivity to the gateway from the cloud side
   • Confirm routing is restored for cloud-to-on-premises traffic
   • Validate that all VMs on the extended network can reach their gateway

If the error persists after following these steps, contact Broadcom Support for further assistance.

Please provide the below information when opening a support request with Broadcom for this issue:

• Service mesh version before and after upgrade
• Extended network configuration details
• Network topology diagram showing cloud and on-premises segments
• Diagnostic logs from the time of the issue