Resolving "Deactivation failed" Error During HCX Undeployment in VMware Cloud on AWS

Products

• VMware Cloud on AWS
• VMware HCX

Issue/Introduction

When undeploying VMware HCX from VMware Cloud on AWS, users may encounter a "Deactivation failed" error during the undeployment process. This error specifically occurs during the deactivation stage of the undeployment workflow when service mesh & other HCX connections are still present in the environment. The error prevents the completion of the HCX undeployment process and can leave the deployment in a partially removed state.

Below is a screenshot of this error

Environment

• VMware Cloud on AWS
• VMware HCX
• vCenter Server

Cause

The "Deactivation failed" error occurs due to one or more of the following conditions:

1. Active service mesh connections are present during the undeployment attempt
2. The undeployment process was initiated without following the proper sequence of decommissioning steps
3. A stuck task from a failed undeployment attempt prevents further operations

Resolution

Follow these steps to resolve the HCX deactivation failure

1. Verify Prerequisites
   • Confirm all migrations and replications, including DR operations, are finalized
   • Verify no migration or protection operations are running
   • Ensure all network extensions are removed from source-site data centers
   • Check that all unextended networks are removed from the destination site
2. Clear Network Components
   • Navigate to Network & Security > Network > Segments in VMware Cloud on AWS
   • Remove any remaining unextended networks
   • For DX deployments, clear all direct connect private interfaces
3. Remove Service Mesh
   • Navigate to HCX Manager Service UI
   • Go to Interconnect > Service Mesh
   • Remove all existing service mesh configurations
   • Verify service mesh instances no longer appear in the HCX Manager Service UI
4. Disconnect Site Pairings
   • From the HCX dashboard, navigate to Site Pairing
   • Disconnect all site pairs
5. Clear Failed Tasks
   • Identify any stuck undeployment tasks
   • Work with Broadcom Support if necessary to kill any persistent failed tasks
6. Remove Firewall Rules
   • Access the VMware Cloud on AWS management interface
   • Navigate to Networking & Security > Gateway Firewall > Management Gateway
   • Delete any rules related to HCX
7. Retry Undeployment
   • Access the VMware Cloud on AWS management interface
   • Select the SDDC with the failed HCX deployment
   • Click Undeploy HCX

Note: Following the proper undeployment sequence as documented in the VMware HCX Guide below is crucial for preventing this issue. Always ensure all dependencies are removed in the correct order before attempting to undeploy HCX.

Additional Information

See this article for more information - Uninstalling HCX in VMware Cloud on AWS Deployments