We appear to have an issue with DXOI Zookeeper. It has prevented us from starting up DXOI even when done manually
From the jarvis-zookeeper-0 logs
main-SendThread(zookeeper:2181)] WARN org.apache.zookeeper.ClientCnxn - Session 0x0 for server zookeeper/<unresolved>:2181, Closing socket connection. Attempting reconnect except it is a SessionExpiredException.
java.lang.IllegalArgumentException: Unable to canonicalize address zookeeper/<unresolved>:2181 because it's not resolvable
at org.apache.zookeeper.SaslServerPrincipal.getServerPrincipal(SaslServerPrincipal.java:78)
at org.apache.zookeeper.SaslServerPrincipal.getServerPrincipal(SaslServerPrincipal.java:41)
at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1142)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1192)
"Session 0x0 for server zookeeper/<unresolved>:2181"
Seems to be an anomaly where its trying to resolve an address and not getting it correct.
Resources were at the minimum required. By adding another 12 GB memory on each node as well as adding 2 more CPU's on each node as well, OI was able to start and run successfully.