NSX Host or Edge Transport Nodes report 'Unknown' status intermittently

Products

• VMware NSX

Issue/Introduction

• NSX hosts or Edge Transport nodes report "UNKNOWN" status intermittently in NSX UI
• The status changes between "Unknown" Status and "UP" Status very randomly 
• NSX version is 4.1 
• NSX manager logs show "sslv3 alert bad certificate"    

/var/log/syslog: 

            [TIMESTAMP] userEventTriggered: unhandled event SslHandshakeCompletionEvent(javax.net.ssl.SSLHandshakeException: error:14094412:SSL routines:ssl3_read_bytes:sslv3 alert bad certificate)

/var/log/idps-reporting/idps.log:

            [TIMESTAMP]  WARN netty-4 NettyClientRouter 4103 userEventTriggered: unhandled event SslHandshakeCompletionEvent(javax.net.ssl.SSLHandshakeException: error:14094412:SSL routines:ssl3_read_bytes:sslv3 alert bad certificate)

             [TIMESTAMP] ERROR netty-8 ClientHandshakeHandler 4103 exceptionCaught: Exception DecoderException caught.
io.netty.handler.codec.DecoderException: javax.net.ssl.SSLHandshakeException: error:14094412:SSL routines:ssl3_read_bytes:sslv3 alert bad certificate

Environment

VMware NSX

Cause

The NSX manager is unable to validate certificate for the Hosts/Edge Transport nodes 

Resolution

To resolve this issue, replace the NSX manager by following these steps:

• Identify the NSX manager that is reporting the "sslv3 alert bad certificate" error 
• Delete the NSX manager using the delete option in NSX UI, and then deploy a new manager by using the add NSX appliance option
• If the NSX manager is manually deployed,  log in to any other NSX manager cli and use the detach node <UUID> command to detach the manager from the cluster. Once the manager is detached, please power off and delete the virtual machine for the NSX manager in vSphere and deploy a new manager from the NSX UI