Starting Vertica on all nodes failed with exit code 1

Products

• CA Infrastructure Management
• CA Performance Management - Usage and Administration

Issue/Introduction

Problem: 

Vertica crash on startup with the message error:

Starting nodes:
v_dr01_node0001 (10.2.2.52)

Starting Vertica on all nodes. Please wait, databases with large catalogs may take a while to initialize.

x.x.x.x failed with exit code 1. Check /opt/data/catalog/DR01/dbLog for more information.
Press RETURN to continue

 

Environment:  

PM 2.6

Cause: 

Due to the number if "inodes" on the file system being too small the Vertica DB is not started

# df -i

Filesystem Inodes IUsed IFree IUse% Mounted on
/dev/sdb1 3276800 3276800 0 100% /opt/data

 

Resolution:

Remove some files like old *.log files

Move Vertica backup for another FS and change the Vertica Backup .ini file informing the new FS

This bash command may help the cust in order to find out the the number of files in each directory:
find . -xdev -type f | cut -d "/" -f 2 | sort | uniq -c | sort -n

Re-create the file system using the following command and specify the number of inodes after the -N parameter:
mkfs.ext4(8) -N *num_of_inodes_here*

 

Additional Information:

N/A

Environment

Release: IMDAGG99000-2.5-Infrastructure Management-Data Aggregator
Component: