It is not supported to remove the compute manager when NSX-T components are deployed on vCenter.
From NSX-T version 2.5.3 onwards it will warn before you try to remove the compute manager from the NSX-T UI.
As can be seen in the administration guide here:
Workaround:
vSphere Cli commands can be used on the ESXi host to power on the VMs.
See the following KB for details: Powering on a virtual machine from the command line when the host cannot be managed using VMware vSphere Client