Rabbitmq service fails to start on vIDM node

Products

• VCF Operations/Automation (formerly VMware Aria Suite)

Issue/Introduction

• vIDM admin UI shows rabbitmq service not running successfully
• You have verified there is plenty of disk space available on the system. To check run the following command

df -h

• Running the command 'service rabbitmq-server status' or 'journalctl -xe' shows the following error:

Starting broker

Boot failed

Error during startup: error, schema_integrity_check_failed, table_missing, rabbit_index_routing

or

Error: feature flags: ‘classic_queue_type_delivery_support’ required feature flat not enabled it must be enabled before upgrading RABBITMQ

Failed to initialize feature flags registry: disabled_required_feature_flag, classic_queue_type_delivery_support

Boot failed

Environment

vIDM 3.3.7

Resolution

To resolve this issue follow the steps below:

NOTE - If there are disk space issues on the system please address those before attempting the steps below. A full partition on the system can also cause the rabbitmq service fail to start 

1. Take a backup/snapshot of the vIDM appliance(s) having issues starting rabbitmq service
2. Run the following commands in order -

systemctl stop rabbitmq-server.service

rm -rf /db/rabbitmq/data

service horizon-workspace restart

systemctl start rabbitmq-server.service

3. Log back into the vIDM admin UI and verify the rabbitmq service is now started successfully