"You are in emergency mode" with Failed to start FIPS and Security service messages seen when Ubuntu fails to boot in VCF Operations for Networks appliance

Products

• VCF Operations for Networks

Issue/Introduction

• When a VCF Operations for Networks appliance based on Ubuntu fails to boot, a message similar to the following may be seen:
  
  You are in emergency mode. After logging in, type "journalctl -xb" to view system logs, "systemctl reboot" to reboot, "systemctl default" or "exit" to boot into default mode. Give root password for maintenance.
  
  
• With the FAILED messages
  
  "Failed to start FIPS SSL tunnel for network daemons."
"Failed to start Security Auditing Service"
  
  

Environment

• Aria Operations for Networks 6.13.0
• Aria Operations for Networks 6.14.0
• Aria Operations for Networks 6.14.1

Cause

Cluster nodes were not shutdown in reverse chronological order per Shutdown and Start a Setup and Best practices to shutdown Aria Operations for Networks Clustered deployments was not followed.

Resolution

Confirm that that is not a match of "You are in emergency mode" message seen when Ubuntu fails to boot in VCF Operations for Networks appliance with the assistance of Broadcom Support. 

If you encounter this issue, open a support case with Broadcom Support to repair your Aria Operations for Networks deployment. For more information, see Creating and managing Broadcom support cases

In the event that the nodes cannot recover a backup must be restored per VMware Aria Operations for Networks Backup and Restore