NSX manager Cluster Degraded and all services on the Manager node is down

Products

• VMware NSX

Issue/Introduction

• NSX Manager cluster displays "Cluster Degraded" alarm in the UI.
• One or more NSX Manager nodes report degraded status or become unreachable via network (ping).
• All the services are reporting as DOWN in the NSX manager UI
  
  

• Web console access on the manager node is slow or unresponsive.
• vCenter displays an incorrect power state for the NSX Manager VM (e.g., reports "Powered On" but no "Power On" task is visible, or last task is "Power Off").

Environment

• VMware NSX

Resolution

1. SSH into the NSX Manager node using admin credentials.
2. Invoke the NSX CLI command: get cluster status to identify the service or group member that is down.
   
   Note: If the problematic node is not responding, run the get cluster status command from the working nodes to check the cluster status
3. Determine if the service is running on the node by invoking the API or CLI:
   • Command: get service <service_name>
4. Restart the affected service if it is not running:
   • Command: restart service <service_name>
5. If the issue persists, such as vCenter power status mismatch or node unresponsiveness:
   • Reboot the affected NSX Manager node.
6. After the reboot, verify the node connectivity and cluster status using get cluster status.

Additional Information

• For instructions on log collection, refer to: How to collect NSX support bundles.
• If the issue requires further assistance, contact Broadcom Support: Contact Broadcom Support.