NSX Manager Node Service Alarm reporting DOWN
search cancel

NSX Manager Node Service Alarm reporting DOWN

book

Article ID: 407136

calendar_today

Updated On:

Products

VMware NSX

Issue/Introduction

  • After rebooting or upgrading NSX Manager, you receive 9 to 10 Open alarms similar to:

    Group member ########-####-####-####-############ of service MESSAGING-MANAGER is down.
    Group member ########-####-####-####-############ of service MONITORING is down.

    Recommended Action
    1. Invoke the NSX CLI command 'get cluster status' to view the status of group members of the cluster. 2. Ensure the service for <service_name> is running on node. Invoke the GET /api/v1/node/services/<service_name>/status NSX API or the `get service <service_name>` NSX CLI command to determine if the service is running. If not running, invoke the POST /api/v1/node/services/<service_name>?action=restart NSX API or the `restart service <service_name>` NSX CLI to restart the service. 3. Check /var/log/ of service <service_name> to see if there are errors reported. View Knowledge Base

  • If these alarms are manually resolved, after a few minutes, it also reports and the alarm changes to Open.
  • Running the command get cluster status from the NSX Manager as admin, you see that all services are up and running, and no service is down.
  • From the NSX Manager UI, under System -> Configuration -> Appliances, the cluster status shows as "Stable", and all NSX Manager nodes are showing green with some nodes displaying Open alarms.
  • When clicking on "View Details", the Operation Status is green for all services:

Resolution

If you believe you have encountered this issue, please open a support case with Broadcom Support and refer to this KB article.

For more information, see Creating and managing Broadcom support cases.

 

Workaround:

  • Perform a rolling reboot of the NSX Managers; you must reboot them one at a time. Wait for the rebooted NSX Manager to be online before rebooting another.
  • Once all nodes have been rebooted, please manually resolve the alarm again, and this time the alarms will not be "Open" again.

Additional Information

Reboot an NSX Manager

If you are contacting Broadcom support about this issue, please provide the following:

  • NSX Manager support bundles (before rebooting the nodes).
  • Screenshot of the Open Alarms displaying on the NSX UI
  • Screenshot of the NSX UI -> System -> Appliances -> View details for each NSX Manager node.

 

Powered by Wolken Software