Database partition could result in data loss

Products

• VMware Integrated OpenStack

Issue/Introduction

• The database is currently partitioned
• Deployment status must be Running in viocli get deployment
• viocli check health reports:

+-------------------+-----------+--------------------------------+-------------------------+
|       NAME        |  RESULT   |             ALARM              |         SKIPPED         |
+-------------------+-----------+--------------------------------+-------------------------+
| mariadb           | Alarms:1  | mariadb cluster                |                         |
|                   | Passed:1  | wsrep_cluster_size != 3        |                         |
+-------------------+-----------+--------------------------------+-------------------------+

• For deployments prior to 7.2, you can run the attached check_db_partition.sh script to detect the issue.  
• Run the following command on vio-manager:

for server in `seq 0 2`;do osctl exec -ti mariadb-server-$server -- mysql --defaults-file=/etc/mysql/admin_user.cnf --host=localhost -e "show status;";done |grep -e wsrep_cluster_size -e wsrep_last_committed

| wsrep_cluster_size                                           | 1       
| wsrep_last_committed                                         | 504496 
| wsrep_cluster_size                                           | 2       
| wsrep_last_committed                                         | 511103  
| wsrep_cluster_size                                           | 2      
| wsrep_last_committed                                         | 511104

 

Environment

7.x

Resolution

This is a known issue affecting VMware Integrated Openstack 7.x.

Workaround:
To work around this issue, contact Broadcom Support and note this Article ID (321805) in the problem description.

Additional Information

If your deployment status is Running and the database isn't partitioned, please apply the fix in VIO Prevent database partition that causes data loss

Impact/Risks:
Database being in partition can lead to data loss.