EDR Server: Rabbitmq Process Won't Start With "enabled_plugins" Error

Products

• Carbon Black EDR (formerly Cb Response)

Issue/Introduction

• Error in the terminal during startup

  • Process execution failure(70):
    Error: {cannot_write_enabled_plugins_file,"/etc/cb/rabbitmq/enabled_plugins",
    eacces}
    Traceback (most recent call last):
    File "/opt/jenkins/build/workspace/build-cbent-signed-staging/code/coreservices/src/cb/utils/exceptions.py", line 62, in decorator
    File "/usr/lib/python2.6/site-packages/cb/maintenance/cbstartup/main.py", line 152, in main
    File "/usr/lib/python2.6/site-packages/cb/maintenance/cbstartup/main.py", line 98, in run
    File "/opt/jenkins/build/workspace/build-cbent-signed-staging/code/coreservices/src/cb/maintenance/cbstartup/actions/init_rabbitmq.py", line 74, in execute
    File "/opt/jenkins/build/workspace/build-cbent-signed-staging/code/coreservices/src/cb/maintenance/cbstartup/actions/init_rabbitmq.py", line 79, in _install_builtin_plugins
    File "/opt/jenkins/build/workspace/build-cbent-signed-staging/code/coreservices/src/cb/maintenance/cbstartup/actions/init_rabbitmq.py", line 99, in _enable_plugin
    File "/opt/jenkins/build/workspace/build-cbent-signed-staging/code/coreservices/src/cb/maintenance/cbstartup/actions/init_rabbitmq.py", line 116, in _run_process
    Exception: Process execution failure(70):
    Error: {cannot_write_enabled_plugins_file,"/etc/cb/rabbitmq/enabled_plugins",
    eacces}

• Master or minions are out of disk space on one of the drives

Environment

• EDR Server: 6.1.0 and above

Cause

Rabbitmq is unable to write to the /etc/cb/rabbitmq/ directory

Resolution

1. Set proper permissions on master and minions:

   • chmod 770 /etc/cb/rabbitmq/

   • chown root:cb /etc/cb/rabbitmq/

   • chown cb:cb /etc/cb/rabbitmq/enabled_plugins

2. Confirm /etc/cb/rabbitmq has space available on both master and minions. If at 100% disk usage, space will need to be added

   • df -h

3. Rename or remove enabled_plugins.tmp on master and minions.

   • mv /etc/cb/rabbitmq/enabled_plugins.tmp /etc/cb/rabbitmq/enabled_plugins.backup

4. Start services

Additional Information

The enabled_plugins.tmp file will get recreated if the partition is full. Remove it after disk space has been cleared.