DR Node 1 down due to ssh connection issue

Products

• DX NetOps

Issue/Introduction

The  DR1 node is down, and can't reach Node 2/3.  2/3 are up and fine,

Seeing the following, when trying to start Vertica DB

Available shortcuts
vhome, state, start, stop, tools

The following hosts could not be reached by SSH and will not be started:
        v_drdata_node0002 (x.x.x.2) will be omitted
        v_drdata_node0003 (x.x.x.3) will be omitted

        Starting nodes:
                v_drdata_node0001 (x.x.x.1)
Error: Quorum not satisfied for drdata.
        1 < minimum 2  of 3 primary nodes.
Attempted to start the following nodes:
Primary
                v_drdata_node0001 (x.x.x.1)
Secondary

Database start up failed.  Cluster partitioned.
Database drdata did not start successfully: Cluster partitioned.

Got the following response, when trying to SSH between nodes

No route to host

Environment

Release : 22.2

Cause

The password for the DB admin account has expired

Resolution

Reset password for the DB admin account, on all Vertica nodes