"mysql restore: failed to make stop request for mysql:...timeout" error when running mysql-restore to restore the MySQL Service Instance database in Tanzu SQL (MySQL) [VMs]

Products

• VMware Tanzu SQL

Issue/Introduction

When attempting to restore the MySQL Service Instance database with mysql-restore, you receive the following error condition:

2021/09/14 18:18:26 Stopping mysql job...
2021/09/14 18:18:56 Stopping mysql job failed: failed to make stop request for mysql: Post http://127.0.0.1:2822/mysql: dial tcp 127.0.0.1:2822: i/o timeout

Environment

Product Version: 2.10

Resolution

This issue is related to an enhancement released on Stemcell 621.141. For more information, refer to Stemcell (Linux) Release Notes | VMware Tanzu Docs - Enhancements.

Added firewall rules to restrict Monit API access to the Monit CLI and BOSH Agent. To see how to grant your program access to the Monit API, examine the new monit wrapper script, found at /var/vcap/bosh/bin/monit.

This enhancement is causing the MySQL restore procedure to timeout. 

To workaround this issue, you can either:

• Prevent the Stemcell upgrade.
• Revert the Stemcell to v641.84 if you already upgraded.

If the Stemcell is upgraded and cannot be reverted, execute these commands when when performing the MySQL restore:

1. ~# source /var/vcap/bosh/etc/monit-access-helper.sh
2. ~# permit_monit_access
3. ~# mysql-restore ...

Note: The issue will be fixed in a future release of MySQL tile 2.10. R&D will not backport the fix to Tanzu SQL (MySQL) [VMs] 2.8 or  Tanzu SQL (MySQL) [VMs] 2.9.