ERROR: The target host does not support the virtual machine’s current hardware requirements.
search cancel

ERROR: The target host does not support the virtual machine’s current hardware requirements.

book

Article ID: 318962

calendar_today

Updated On:

Products

VMware vCenter Server VMware vSphere ESXi

Issue/Introduction

  • Migration of virtual machines between ESXi hosts using vmotion with different CPU Models, fails with following error:

    The target host does not support the virtual machine’s current hardware requirements. To resolve CPU incompatibilities, use a cluster with Enhanced vMotion Compatibility (EVC) enabled. See KB article 1003212.

  • A similar issue can occur when trying to deploy a VM that has feature-set requirements that are either misconfigured or not set up in EVC.
  • As an example, the below errors can be present for a required AVX feature-set:

    This CPU does not appear to support AVX instruction sets.

    FAIL: 15SU3 virtual machines and higher versions require a physical
    CPU that supports the AVX (Advanced Vector Extensions) feature.

  • In some scenarios, specifically when migrating across disparate hardware generations, the validation check may list specific unsupported CPU features, including but not limited to:
    1. MDS_NO
    2. RSBA_NO
    3. IBRS_ALL
    4. RDCL_NO
    5. AVX512VL / AVX512F / AVX512DQ / AVX512CD / AVX512BW
    6. XSAVES / XSAVEC
    7. Protection Keys For User-mode Pages (PKU)

Cause

This issue occurs due to a mismatch in CPU features between the source and target ESXi hosts. vMotion requires the source and destination hosts to present the same CPU generation feature set to ensure virtual machine stability. If the hosts are in the same cluster but have different microcode versions or hardware generations without a unified EVC baseline, the destination host will reject the virtual machine's active hardware requirements.

Resolution

To resolve this issue, follow the steps below:

Note: Changes to EVC require a full power-cycle (power off then power on) to take effect on the virtual machine.

Option 1 (Enable Enhanced vMotion Compatibility (EVC) on the Virtual Machine):

For more information, refer How to Configure Per-VM Enhanced vMotion Compatibility in vSphere 8.0

Option 2 (Enable Enhanced vMotion Compatibility (EVC) on the cluster):

  1. Identify all the CPU models/generation on each ESXi host in the cluster. 

    For example, under host has a CPU Model of Intel Xeon Gold 6330. 

 

 

  1. Go to Broadcom Compatibility Guide, select the CPU Series, on left side select Enhanced vMotion Capability Modes, select the appropriate CPU Generation:

  2. Determine the Lowest Common CPU feature compatible on all ESXi hosts in the cluster. 

For example, as shown in the above figure, the CPU Model Intel Xeon 6330 supports the following EVC baselines: 

  • Intel® Broadwell (oldest generation)
  • Intel® Cascadelake 
  • Intel® Haswell
  • Intel® Icelake
  • Intel® Ivy-Bridge (newest generation)

  1. In the vCenter Server inventory, select the cluster.

  2. Power off all the virtual machines on the hosts with feature sets greater (newer) than the EVC mode.

  1. Click the Configure tab, select VMware EVC, and click Edit.

  1. Enable EVC for the CPU vendor and feature set appropriate for the hosts in the cluster, and click OK.

             

  1. Power on the virtual machines in the cluster to apply the EVC.

Note: If a new ESXi host is added to the EVC enabled cluster, the ESXi host’s CPU features will reflect the configured baseline features. The ESXi host should be added while in maintenance mode.

For more information, refer CPU Compatibility and EVC

If a processor can support EVC level XN, it can also support levels XN-1 to X0.

For example, a processor that supports the Intel "Sandy Bridge" Generation EVC Baseline has an EVC level of L4 (see Table 1.1). Therefore, it can also support EVC levels L3, L2, L1, and L0. However, it cannot support EVC level L5, which corresponds to the Intel "Ivy Bridge" Generation.

Table 1.1: Description of Intel EVC Baselines
 

EVC LevelEVC BaselineDescription
L0Intel "Merom" Gen. (Intel Xeon Core™ 2)Applies baseline feature set of Intel "Merom" Generation (Intel Xeon Core™ 2) processors to all hosts in the cluster.
L1Intel "Penryn" Gen. (formerly Intel Xeon 45nm Core™ 2)Applies baseline feature set of Intel "Penryn" Generation (Intel Xeon 45nm Core™ 2) processors to all hosts in the cluster.
Compared to the Intel "Merom" Generation EVC mode, this EVC mode exposes additional CPU features including SSE4.1.
L2Intel "Nehalem" Gen. (formerly Intel Xeon Core™ i7)Applies baseline feature set of Intel "Nehalem" Generation (Intel Xeon Core™ i7) processors to all hosts in the cluster.
Compared to the Intel "Penryn" Generation EVC mode, this EVC mode exposes additional CPU features including SSE4.2 and POPCOUNT.
L3Intel "Westmere" Gen. (formerly Intel Xeon 32nm Core™ i7)Applies baseline feature set of Intel "Westmere" Generation (Intel Xeon 32nm Core™ i7) processors to all hosts in the cluster. Compared to the Intel "Nehalem" Generation mode, this EVC mode exposes additional CPU features including AES and PCLMULQDQ.

Note: Intel i3/i5 Xeon Clarkdale Series processors that do not support AESNI and PCLMULQDQ cannot be admitted to EVC modes higher than the Intel "Nehalem" Generation mode.

Note: Intel Atom™ C2300-C2700 processors support the Intel "Westmere" Gen. EVC baseline although their architecture is different from the architecture of the Intel "Westmere" Generation processors.
L4Intel "Sandy Bridge" GenerationApplies baseline feature set of Intel "Sandy Bridge" Generation processors to all hosts in the cluster. Compared to the Intel "Westmere" Generation mode, this EVC mode exposes additional CPU features including AVX and XSAVE.

Note: Intel "Sandy Bridge" processors that do not support AESNI and PCLMULQDQ cannot be admitted to EVC modes higher than the Intel "Nehalem" Generation mode.
L5Intel "Ivy Bridge" GenerationApplies baseline feature set of Intel "Ivy Bridge" Generation processors to all hosts in the cluster. Compared to the Intel "Sandy Bridge" Generation EVC mode, this EVC mode exposes additional CPU features including RDRAND, ENFSTRG, FSGSBASE, SMEP, and F16C.

Note: Some Intel "Ivy Bridge" processors do not provide the full "Ivy Bridge" feature set. Such processors cannot be admitted to EVC modes higher than the Intel "Nehalem" Generation mode.
L6Intel "Haswell" Generation
Applies baseline feature set of Intel "Haswell" Generation processors to all hosts in the cluster. Compared to the Intel "Ivy Bridge" Generation EVC mode, this EVC mode exposes additional CPU features including ABMX2,AVX2, MOVBE, FMA, PERMD, RORX/MULX, INVPCID, VMFUNC.
L7Intel "Broadwell" GenerationApplies the baseline feature set of Intel "Broadwell" Generation processors to all hosts in the cluster.

Compared to the Intel® "Haswell" Generation EVC mode, this EVC mode exposes additional CPU features including Transactional Synchronization Extensions, Supervisor Mode Access Prevention, Multi-Precision Add-Carry Instruction Extensions, PREFETCHW and RDSEED
L8Intel "Skylake" GenerationApplies the baseline feature set of Intel "Skylake" Generation processors to all hosts in the cluster.

Compared to the Intel® "Broadwell" Generation EVC mode,this EVC mode exposes additional CPU features including Advanced Vector 
Extensions 512, Persistent Memory Support Instructions, Protection Key Rights, Save Processor Extended States with Compaction, and Save Processor Extended States Supervisor
L9Intel "Cascade Lake" GenerationApplies the baseline feature set of Intel® "Cascade Lake" Generation processors to all hosts in the cluster.

Compared to the Intel® "Skylake" Generation EVC mode, this EVC mode exposes additional CPU features including VNNI and XGETBV with ECX = 1.
L10Intel "Ice Lake" GenerationApplies the baseline feature set of Intel® "Ice Lake" Generation
processors to all hosts in the cluster.

Compared to the Intel "Cascade Lake"
Generation EVC mode, this EVC mode exposes additional CPU features including SHA extensions, Vectorized AES, User Mode Instruction Prevention, Read Processor ID, Fast Short REP MOV, WBNOINVD, Galois Field New Instructions, and AVX512 Integer Fused Multiply Add, Vectorized Bit Manipulation, and Bit Algorithms Instructions
L11Intel "Sapphire Rapids" GenerationApplies the baseline feature set of Intel® "Sapphire Rapids" Generation processors to all hosts in the cluster. Compared to the Intel® "Ice Lake" Generation EVC mode, this EVC mode exposes additional CPU features, including Control-Flow Enforcement Technology, Advanced Matrix Extensions, Supervisor Protection Keys, AVX-VNNI, AVX512 FP16, AVX512 BF16, CLDEMOTE, SERIALIZE, WBNOINVD, and MOVDIRI instructions.
 

Table 1.2: Description of AMD EVC Baselines
 

EVC LevelEVC BaselineDescription
A0AMD Opteron™ Generation 1Applies baseline feature set of AMD Opteron™ Generation 1 (Rev. E) processors to all hosts in the cluster.
A1AMD Opteron™ Generation 2Applies baseline feature set of AMD Opteron™ Generation 2 (Rev. F) processors to all hosts in the cluster.
Compared to the AMD Opteron™ Generation 1 EVC mode, this EVC mode exposes additional CPU features including CPMXCHG16B and RDTSCP.
A3AMD Opteron™ Generation 3Applies baseline feature set of AMD Opteron™ Generation 3 (Greyhound) processors to all hosts in the cluster.
Compared to the AMD Opteron™ Generation 2 EVC mode, this EVC mode exposes additional CPU features including SSE4A, MisAlignSSE, POPCOUNT and ABM (LZCNT).

Note: Due to 3DNow!™ support being removed from AMD processors after mid 2010, use AMD Opteron™ Generation 3 (no 3DNow!™) when possible to avoid compatibility issues with future processor generations.
A2, B0AMD Opteron™ Generation 3 (no 3DNow!™)Applies baseline feature set of AMD Opteron™ Generation 3 (Greyhound) processors with 3DNow!™ support removed, to all hosts in the cluster.
This mode allows preparing clusters containing AMD hosts to accept AMD processors without 3DNow!™ support.
B1AMD Opteron™ Generation 4Applies baseline feature set of AMD Opteron™ Generation 4 (Bulldozer) processors to all hosts in the cluster.
Compared to the AMD Opteron™ Generation 3 (no 3DNow!™) EVC mode, this EVC mode exposes additional CPU features including SSSE3, SSE4.1, AES, AVX, XSAVE, XOP, and FMA4.
B2AMD Opteron™ "Piledriver" GenerationApplies baseline feature set of AMD Opteron™ "Piledriver" Generation processors to all hosts in the cluster.
Compared to the AMD Opteron™ Generation 4 EVC mode, this EVC mode exposes additional CPU features including FMA, TBM, BMI1, and F16C.
B3AMD Opteron™ "Steamroller" GenerationApplies baseline feature set of AMD Opteron™ "Steamroller" Generation processors to all hosts in the cluster.
Compared to the AMD Opteron™ "Piledriver" EVC mode, this EVC mode exposes additional CPU features including XSAVEOPT RDFSBASE, RDGSBASE, WRFSBASE, WRGSBAS and FSGSBASE.
B4AMD "Zen" GenerationApplies baseline feature set of AMD "Zen" Generation processors to all hosts in the cluster.

Compared to the AMD Opteron™ "Steamroller" EVC mode, this EVC mode exposes additional CPU features including RDRAND, SMEP, AVX2, BMI2, MOVBE, ADX, RDSEED, SMAP, CLFLUSHOPT, XSAVES, XSAVEC, SHA, and CLZERO.
B5AMD "Zen 2" GenerationApplies the baseline feature set of AMD "Zen 2" Generation processors to all hosts in the cluster.

Compared to the AMD "Zen" Generation EVC mode, this EVC mode exposes additional CPU features including CLWB, UMIP, RDPID, XGETBV with ECX = 1, WBNOINVD, and GMET.
B6AMD "Zen 3" GenerationApplies the baseline feature set of AMD "Zen 3" Generation processors to all hosts in the cluster. Compared to the AMD "Zen 2" Generation EVC mode, this EVC mode exposes additional CPU features, including always serializing LFENCE, INVPCID, PSFD, SSBD, PCID, PKU, VAES, VPCLMULQDQ, and shadow stacks.
B7AMD 'Zen4" GenerationApplies the baseline feature set of AMD "Zen 4" Generation processors to all hosts in the cluster. Compared to the AMD "Zen 3" Generation EVC mode, this EVC mode exposes additional CPU features including Fast Short CMPSB and STOSB, Automatic IBRS, AVX512BF16, AVX512BITALG, AVX512BW, AVX512CD, AVX512DQ, AVX512F, AVX512IFMA, AVX512VBMI, AVX512VBMI2, AVX512VL, AVX512VNNI, AVX512VPOPCNTDQ, GFNI, IBRS, and Upper Address Ignore.
 



Workaround:

If a masked baseline is not required for the immediate migration path (e.g., migrating a VM permanently from an old cluster to a newer cluster where EVC is not yet configured):

  1. Locate the cluster configuration in the vSphere Client.
  2. Temporarily Disable VMware EVC on the cluster where the restriction is blocking operations.
  3. Initiate the migration wizard again.
  4. Once the VM is registered on the newer hardware, re-evaluate and enable the appropriate EVC baseline for the new cluster.

OR

If a live vMotion is not possible, perform a Powered-Off migration. This allows the VM to adopt the hardware feature set of the destination host upon the next power-on.

OR

  1. Initiate a Clone operation of the virtual machine from the source host to the destination host.
  2. Once the cloning task completes successfully, log in to the source host UI and Power Off the original virtual machine.
  3. Log in to the destination host UI and Power ON the newly cloned virtual machine.
  4. Validate the VM configuration, network connectivity, and application functionality.

Additional Information

Powered by Wolken Software