This is a known issue affecting VMware Integrated Openstack 6.0.
Workaround:
- Check disk usage of the rabbitmq pod:
osctl exec rabbitmq1-rabbitmq-0 df
Note: Pay attention to Use% of the following line:
/dev/sdc 20511312 50440 20444488 1% /var/lib/rabbitmq
- Open interactive TTY to the rabbitmq pod
osctl exec -it rabbitmq1-rabbitmq-0 /bin/bash
- Set rabbitmq TTL run the following commands:
for vhost in nova glance keystone neutron heat barbican cinder;do rabbitmqctl set_policy --vhost ${vhost} --priority 0 --apply-to all ha_ttl_${vhost} '(notifications)\.' '{"ha-mode":"all","ha-sync-mode":"automatic","message-ttl":70000}' ; done
rabbitmqctl set_policy TTL ".*" '{"message-ttl":70000}' --apply-to queues
- If the /dev/sdc partition is still full we need to clear out the *.idx files
rabbitmqctl list_queues
rabbitmqctl purge queue name=<name of queue>
- Restart rabbitmq if stopped
rabbitmqctl force_boot