Unintended Cross-Site VM Migrations Observed in vCenter with a Cisco HyperFlex Environment

Products

• VMware vCenter Server

Issue/Introduction

• Virtual machines are being migrated between sites within the cluster without awareness, resulting in resource overload on the destination hosts.
• From the journalctl logs [journalctl -b|grep ClusterReconfiguredEvent|grep com.springpath.sysmgmt]:

  • MONTH DATE HH:MM:SS vCenter-FQDN vpxd[6718]: Event [4764606] [1-4] [YYYY-MM-DDTHH:MM:SS.SSSSSSZ] [vim.event.ClusterReconfiguredEvent] [info] [com.springpath.sysmgmt.domain-c****] [xxxxxx] [4764605] [Reconfigured cluster CLUSTER_NAME in datacenter DATACENTER_NAME
    Modified:
    (name = "SiteB_VmGroup", userCreated = true, uniqueID = <unset>, vm = ('vim.VirtualMachine:vm-2143', 'vim.VirtualMachine:vm-2126', 'vim.VirtualMachine:vm-2135', 'vim.VirtualMachine:vm-2136', 'vim.VirtualMachine:vm-2128', 'vim.VirtualMachine:vm-2144', 'vim.VirtualMachine:vm-2129', 'vim.VirtualMachine:vm-2145', 'vim.VirtualMachine:vm-2130', 'vim.VirtualMachine:vm-2137', 'vim.VirtualMachine:vm-2146', 'vim.VirtualMachine:vm-2138', 'vim.VirtualMachine:vm-2139', 'vim.VirtualMachine:vm-2097', 'vim.VirtualMachine:vm-2101', 'vim.VirtualMachine:vm-2140', 'vim.VirtualMachine:vm-2098', 'vim.VirtualMachine:vm-2099') -> (name = "SiteB_VmGroup", userCreated = true, uniqueID = <unset>, vm = ('vim.VirtualMachine:vm-2143', 'vim.VirtualMachine:vm-2126', 'vim.VirtualMachine:vm-2135', 'vim.VirtualMachine:vm-2136', 'vim.VirtualMachine:vm-2128', 'vim.VirtualMachine:vm-2144', 'vim.VirtualMachine:vm-2129', 'vim.VirtualMachine:vm-2145', 'vim.VirtualMachine:vm-2130', 'vim.VirtualMachine:vm-2137', 'vim.VirtualMachine:vm-2146', 'vim.VirtualMachine:vm-2131', 'vim.VirtualMachine:vm-2138', 'vim.VirtualMachine:vm-2139', 'vim.VirtualMachine:vm-2097', 'vim.VirtualMachine:vm-2101', 'vim.VirtualMachine:vm-2140', 'vim.VirtualMachine:vm-2098', 'vim.VirtualMachine:vm-2099')

• The VM group of Site B was updated with Site A VMs along with Site B VMs and the VM group of Site-A was empty.

Environment

vCenter Server 8.x.

Cause

The cluster was reconfigured by com.springpath.sysmgmt Cisco's Hyperflex plugin.

Resolution

Reach out to Cisco Hyperflex Team to further investigate the issue.