Inventory sync for VCF Operations for Logs fails with Error LCMVRLICONFIG40116

Products

• VCF Operations

Issue/Introduction

Inventory sync triggered from VCF Operations (Lifecycle) / VCF Fleet Management for VCF Operations for Logs fails with the following error:

Error Code: LCMVRLICONFIG40116
LCMVRLICONFIG40116 
java.net.ConnectException: Connection refused (Connection refused)

Environment

• VCF Operations 9.0.x
• VCF Fleet Management 9.0.x
• VCF Operations for Logs 9.0.x

Cause

This issue occurs when the Cassandra service is not running on the VCF Operations for Logs cluster nodes. When Cassandra is down, VCF Operations for Logs is unable to service incoming requests.

 

The Cassandra service status can be validated by running the following command on the VCF Operations for Logs nodes:

nodetool-no-pass status

Resolution

Follow the below steps to restore the Cassandra service by performing a sequential restart of the VCF Operations for Logs cluster and complete inventory sync:

1. Login to the vCenter Server.
2. Shut down all worker nodes.
3. Shut down the primary node.
4. Power on the primary node and allow all services to initialize completely.
5. Power on the worker nodes.
6. SSH as root on all nodes and verify Cassandra cluster health using:

   nodetool-no-pass status

7. Confirm that all nodes report an Up/Normal (UN) state.
8. Verify that the VCF Operations for Logs UI is accessible.
9. Retry the inventory sync operation from VCF Operations (Lifecycle) / VCF Fleet Management UI.

Note: If the Cassandra does not recover after power cycling the cluster, please open a Support Request with Broadcom Technical Support and cite this Article ID (442410) in the problem description. For more information, see Creating and managing Broadcom support cases.