DR install failed with missing kafka files error

Products

• CA Performance Management - Usage and Administration
• DX NetOps

Issue/Introduction

My data repository install failed with the following error

Install failed on xx.xx.x.xx
(xx.xx.x.xx) Installation failed: warning: /tmp/dbRPM.rpm: Header V3 RSA/SHA256 Signature, key ID f54b82a0: NOKEY Shutting down vertica services for upgrade  Vertica Analytic Database v10.1.1-0 successfully installed on host xxxxxxxx  To complete your NEW installation and configure the cluster, run:   /opt/vertica/sbin/install_vertica  To complete your Vertica UPGRADE, run:  /opt/vertica/sbin/update_vertica  ----------------------------------------------------------------------------------  Important ----------------------------------------------------------------------------------  Before upgrading Vertica, you must backup your database.  After you restart your    database after upgrading, you cannot revert to a previous Vertica software version. ----------------------------------------------------------------------------------   View the latest Vertica documentation at https://www.vertica.com/documentation/vertica/  warning: file /opt/vertica/packages/kafka/lib/libkafka.so.9.1.1: remove failed: No such file or directory warning: file /opt/vertica/packages/kafka/lib/log4j-core-2.3.jar: remove failed: No such file or directory warning: file /opt/vertica/packages/kafka/lib/log4j-api-2.3.jar: remove failed: No such file or directory warning: file /opt/vertica/packages/kafka/lib/disruptor-3.3.2.jar: remove failed: No such file or directory
Installation FAILED with errors.

Environment

DX NetOps CAPM Release : 21.2.x or later
Component : Performance Management Upgrades

Cause

Sometimes, in a multi-node environments, the uninstall_package didn't tell all vertica nodes to unload kafka.   So when the nodes restart, they still look for the "manually" deleted library.

The missing files are listed in the error message (highlighted above in the description):

/opt/vertica/packages/kafka/lib/libkafka.so.9.1.1
/opt/vertica/packages/kafka/lib/log4j-core-2.3.jar
/opt/vertica/packages/kafka/lib/log4j-api-2.3.jar
/opt/vertica/packages/kafka/lib/disruptor-3.3.2.jar

As well as:

/opt/vertica/packages/kafka/lib/libkafka.so
/opt/vertica/packages/kafka/lib/libkafka

Resolution

You can take the zip file attached to this KB, expand it and copy it onto the failed nodes in the above locations, then restart the upgrade.  If necessary you may need to rebuild the /opt/vertica/packages/kafka/lib/ directory before adding the library files to the node called out in the error message: Install failed on xx.xx.x.xx

Alternately, you can run:

touch /opt/vertica/packages/kafka/lib/libkafka.so.9.1.1
touch /opt/vertica/packages/kafka/lib/log4j-core-2.3.jar
touch /opt/vertica/packages/kafka/lib/log4j-api-2.3.jar
touch /opt/vertica/packages/kafka/lib/disruptor-3.3.2.jar
touch /opt/vertica/packages/kafka/lib/libkafka.so
touch /opt/vertica/packages/kafka/lib/libkafka

The above are the files listed as missing in the install log. These commands will create an empty file with the same name, then when the installer is re-run, it will see these files when checking for Kafka and clear the error.