[VMC on AWS] Service Mesh creation failed with "Interconnect Service Workflow PrepareFleetNetwork failed" error

Products

• VMware HCX
• VMware Cloud on AWS

Issue/Introduction

Symptoms:

• You cannot create service mesh of HCX.
• It failed in PREPARE_FLEET_POOLS stage
• You can see error like followings in service mesh UI or HCX Connector's /common/logs/admin/app.log

20XX-XX-XX XX:XX:XX.XXX UTC [InterconnectService_SvcThread-37061, SM:servicemesh-280b62ed-7b32-45c7-ac2c-b59dd335370d, IX:a841b70a-fd46-4b08-90ea-cbc7a1858070, J:e07e5b70, , TxId: 1f5de51d-cd99-4f84-9b99-b8b6d5ba3d84] ERROR c.v.v.h.s.i.PrepareFleetPools- PrepareFleetNetwork failed, errorCode:null. stacktrace:null, errorMessage:Cannot find a Transport Zone with Global/Universal Scope in NSX. Please check your NSX configuration
20XX-XX-XX XX:XX:XX.XXX UTC [InterconnectService_SvcThread-37061, SM:servicemesh-280b62ed-7b32-45c7-ac2c-b59dd335370d, IX:a841b70a-fd46-4b08-90ea-cbc7a1858070, J:e07e5b70, , TxId: 1f5de51d-cd99-4f84-9b99-b8b6d5ba3d84] ERROR c.v.v.h.s.i.PrepareFleetPools- PrepareFleetPools failed in state PROCESS_PREPARE_FLEET_NETWORK_RESULT. Error: Interconnect Service Workflow PrepareFleetNetwork failed. Error: ["Cannot find a Transport Zone with Global\/Universal Scope in NSX. Please check your NSX configuration"].
java.lang.RuntimeException: Interconnect Service Workflow PrepareFleetNetwork failed. Error: ["Cannot find a Transport Zone with Global\/Universal Scope in NSX. Please check your NSX configuration"]

Resolution

This error implies there is an incorrect configuration of NSX-v or NSX-T onpremise site for HCX.
To isolate the problem. please check the followings.
 

• Check if you use NSX network for HCX network extension.

If you do not use overlay networks for HCX network extension, unregister NSX from https://<hcx-manager-ip>:9443 > Configuration > NSX.
 

• Check the NSX's required configuration for HCX

Please check if required NSX's configuration for HCX is satisfied.
For example, Cluster configured with NSX is required for HCX deployment.
You can see its detail from NSX Requirements for HCX Appliance Deployments too.