Cloud Controller and Diego BBS take a long time to recover when there is degraded mysql backend

Products

• Operations Manager

Issue/Introduction

When the mysql deployment in one AZ is degraded, it takes more than 10 mins for the BBS convergence process to drop the connection and switch to the next available AZ.

bbs.stderrr.log contains connection errors to MySQL database:

[mysql] 2025/08/24 17:27:43 connection.go:49: read tcp <Diego BBS IP>:58884-><MySQL proxy IP>:3306: read: connection reset by peer

Resolution

Diego BBS contains a 10 minute BBS DB timeouts in the code. This value is considered unnecessarily high and can delay the recovery of Cloud Controller and BBS convergence when a degraded mysql database occurs.

Future versions of Tanzu Platform for Cloud Foundry will reduce this timeout, which will improve recovery time when a degraded backend database occurs.