‘Get managers’ output on NSX manager nodes report incorrect status.

Products

• VMware NSX

Issue/Introduction

• Though all nsx managers nodes are Up and connected . Running ‘Get managers’ command would show the output incorrect as few nodes are on standby.

Example :

nsx-mngr-01> get managers
Tue Jul 16 2024 UTC 07:38:08.081
- X.X.120.1    Connected (NSX-RPC) *
- X.X.120.2    Connected (NSX-RPC)
- X.X.120.3    Standby (NSX-RPC)

nsx-manager-02> get managers
Tue Jul 16 2024 UTC 07:38:18.008
- X.X.120.1    Standby (NSX-RPC)
- X.X.120.2    Standby (NSX-RPC) *
- X.X.120.3    Standby (NSX-RPC)

nsx-mngr-03> get managers
Tue Jul 16 2024 UTC 07:48:51.915
- X.X.120.1    Connected (NSX-RPC)
- X.X.120.2    Connected (NSX-RPC)
- X.X.120.3    Standby  (NSX-RPC) *

• Port 1234 connectivity from the NSX manager 

nsx-mngr-01:~# netstat -anlp | grep 1234
tcp        0      0 0.0.0.0:1234            0.0.0.0:*               LISTEN      3424/appl-proxy
tcp        0      0 X.X.120.1:33236     X.X.120.2:1234      ESTABLISHED 3424/appl-proxy
tcp        0      0 X.X.120.1:1234      X.X.130.11:51862    ESTABLISHED 3424/appl-proxy
tcp        0      0 X.X.120.1:1234      X.X.120.3:51752     ESTABLISHED 3424/appl-proxy
tcp        0      0 X.X.120.1:1234      X.X.130.12:56854    ESTABLISHED 3424/appl-proxy

nsx-mngr2-02:~# netstat -anlp | grep 1234
tcp        0      0 0.0.0.0:1234            0.0.0.0:*               LISTEN      18306/appl-proxy
tcp        0      0 X.X.120.2:1234      X.X.120.3:53888     ESTABLISHED 18306/appl-proxy
tcp        0      0 X.X.120.2:1234      X.X.130.11:36556    ESTABLISHED 18306/appl-proxy
tcp        0      0 X.X.120.2:1234      X.X.130.12:33722    ESTABLISHED 18306/appl-proxy
tcp        0      0 X.X.120.2:1234      X.X.120.1:33236     ESTABLISHED 18306/appl-proxy

nsx-mngr-03:~# netstat -anlp | grep 1234
tcp        0      0 0.0.0.0:1234            0.0.0.0:*               LISTEN      19321/appl-proxy
tcp        0      0 X.X.120.3:51752     X.X.120.1:1234      ESTABLISHED 19321/appl-proxy
tcp        0      0 X.X.120.3:53888     X.X.120.2:1234      ESTABLISHED 19321/appl-proxy

• This is just a command output inconsistency and does not have any impact.

Environment

Issue is reported on NSX versions below 3.2.4 , 4.0.x and 4.1.x 

Cause

On impacted versions , Only outgoing connections to other manager nodes over TCP 1234 is considered as “Connected” . The connections over incoming TCP 1234 and to self is marked as  “Standby”

Resolution

Issue is fixed in NSX manager version 3.2.4 and 4.2.

Additional Information

After the upgrade to fixed version, we are expecting to see all the NSX managers in connected state.

Example:

nsx-mngr-01> get managers
Wed Jul 17 2024 UTC 09:04:50.106
- X.X.120.1    Connected (NSX-RPC)
- X.X.120.2    Connected (NSX-RPC) *
- X.X.120.3    Connected (NSX-RPC)

The * symbol denotes the current master for management plane.