HCX Underlay migration services are not meeting the minimum threshold metrics for uplink interface

Products

• VMware HCX

Issue/Introduction

• The following messages or alerts may be seen in HCX Manager UI:
  • HCX Underlay - The following migration services do not satisfy the minimum threshold metrics for uplink: <hcx_network_profile> of service mesh : <HCX_Mesh> Unhealthy Services : [VMOTION, RAV].
InstanceID: ########-####-####-####-############
• Running "Transport Analytics" from source HCX-Manager UI displays the below results:
  
• From IX appliance running the <MTR #.#.#.#> command shows the following results:
  
  • This traceroute shows a vast difference in latency. 

Environment

VMware HCX 

Cause

• With a mixture of FOUTRACE and MTR commands from IX appliance we have identified inconsistency in latency on the uplink path. 
• Hops 5 and 6 show more than 2x the amount of latency as expected.

Resolution

• Investigate the physical devices on the underlay for any misconfiguration or contention that could explain the spikes in latency. 
• On silver peak appliances, disable any WAN optimization features. 

Additional Information

• Starting SSH on the HCX Manager
• Using the HCX Manager Central CLI
• Using Central CLI to Connect to HCX Services
• Verifying Underlay Network Performance for Service Mesh Uplinks