VMware Cloud Director MQTT/AMQP disconnects reported by external services like Zerto

Products

• VMware Cloud Director

Issue/Introduction

An external service, such as Zerto, that consumes events from the VMware Cloud Director (VCD) Message Queuing Telemetry Transport (MQTT) provider is reporting recurring disconnects. The VCD administrative check for the Advanced Message Queuing Protocol (AMQP) service, found in VCD Admin > Extensibility, completes successfully every time, indicating that the core AMQP service is running correctly within VCD.

This issue is observed in VCD 10.6.1.1 and is characterized by the VCD service failing to consistently send event data to the RabbitMQ server.

Environment

 

• Product: VMware Cloud Director (VCD)

• Version: 10.6.x

• Component: Extensibility/AMQP Provider

• Related Component: RabbitMQ

 

Cause

This behavior is caused by a known issue in VMware Cloud Director 10.6.1.1 where VCD fails to send events to the RabbitMQ server. A large number of events in the VCD event table causes the event processing to fail, resulting in VCD not sending events.

Resolution

The definitive resolution is to upgrade your VCD instance. If an immediate upgrade is not possible, a workaround can be applied.

Option 1: Upgrade (Recommended)

Upgrade VMware Cloud Director to version 10.6.1.2 or higher, as this version contains the fix for the event processing failure.

Option 2: Apply Workaround (If not upgrading)

Delete unnecessary or non-essential events from the VCD event table. This will reduce the event count, allowing VCD to process and send new events to RabbitMQ. Contact Broadcom support for assistance with deleting entries from event table. 

Additional Information

Supported RabbitMQ Version: VMware Cloud Director 10.6.x requires a supported RabbitMQ version (3.10.x, 3.11.x, or 3.12.x).

Also see, VMware Cloud Director 10.6.1.2 resolved issues.