HCX - Service Mesh deployment fails with "Could not find an OVERLAY transport zone which is attached to all ESX hosts in the compute profile"

Products

• VMware HCX

Issue/Introduction

Service Mesh deployment fails with the following error:

Service Mesh creation failed. Interconnect Service Workflow PrepareFleetPools failed. Error: Interconnect Service Workflow PrepareFleetNetwork failed. Error: Unable to create the HCX service mesh. Could not find an OVERLAY transport zone that is attached to all ESX hosts in the computed profile <Profile Name> deployment resources/container at site <site-name>

 

The following errors are observed in /common/logs/admi/app.log:

2024-05-08 16:05:41.343 UTC [InterconnectService_SvcThread-26, J:4f60943d, , TxId: ########-####-####-####-#############] ERROR c.v.v.h.s.i.ProcessServiceMesh- ProcessServiceMesh failed in state PROCESS_PREPARE_FLEET_POOL_RESULT. Error: Interconnect Service Workflow PrepareFleetPools failed. Error: Interconnect Service Workflow PrepareFleetNetwork failed. Error: Unable to create the HCX service mesh. Could not find an OVERLAY transport zone which is attached to all ESX hosts in the compute profile <Profile-Name> deployment resources/container at site <Site-Name>.

java.lang.RuntimeException: Interconnect Service Workflow PrepareFleetPools failed. Error: Interconnect Service Workflow PrepareFleetNetwork failed. Error: Unable to create the HCX service mesh. Could not find an OVERLAY transport zone which is attached to all ESX hosts in the compute profile <Profile-Name> deployment resources/container at site <Site-Name>

 

Environment

• HCX version 4.9.1 or earlier.
• NSX is deployed on-premises, but no Overlay-TZ is configured.
• WANOPT is selected during the Service Mesh deployment.

Cause

When using a WAN Optimization (WANOPT) appliance, an Overlay Transport Zone (TZ) is required for communication between the IX appliance and the WANOPT appliance from 4.x to 4.9.1 and occurs if NSX is deployed on-premises but no overlay segment is configured on the ESXi hosts where the WANOPT is deployed.

Resolution

HCX 4.10 introduces a new Network type: HCX Intrasite Contol Network. HCX uses this network for communication between the HCX Interconnect (HCX-IX) and WAN Optimization appliances, offloading task from the Management Network. You can create a dedicated network for communication between IX and WANOPT. If you manually configure the Intrasite Control network, HCX uses that network irrespective of whether NSX is registered with HCX.

For 4.9.1 or earlier:

Deploy the service mesh without WANOPT

Or 

Create a new overlay transport zone for the WANOPT.