Instances creation failing with An error occurred during host configuration

Products

• VMware Integrated OpenStack

Issue/Introduction

• Instances are timing out for creations
  
  
• Openstack showing error similar to:
  Setting instance to ERROR state.: nova.exception.MaxRetriesExceeded: Exceeded maximum number of retries. Exceeded max scheduling attempts 3 for instance <instance UUID>. Last exception: An error occurred during host configuration
  
  
• Nova logs showing error similar to:
  nova-compute[746]: 2025-01-01 00:00:01:001 1 ERROR nova.compute.manager [instance: <instance UUID>] oslo_vmware.exceptions.VimFaultException: An error occurred during host configuration.
nova-compute[746]: 2025-01-01 00:00:01:001 1 ERROR nova.compute.manager [instance: <instance UUID>] Faults: ['PlatformConfigFault']
  
  
• vpxa logs on the host where the create failed are showing error similar to:
  
  2025-01-01 00:00:01:001Z info vpxa[2117462] [Originator@6876 sub=Default opID=n-cpu-########-####-####-####-############] [VpxLRO] -- ERROR task-1111111 -- vpxa -- vpxapi.VpxaService.registerVm: vim.fault.PlatformConfigFault:
--> Result:
--> (vim.fault.PlatformConfigFault) {
-->    faultCause = (vmodl.MethodFault) null,
-->    faultMessage = (vmodl.LocalizableMessage) [
-->       (vmodl.LocalizableMessage) {
-->          key = "com.vmware.esx.hostctl.default",
-->          arg = (vmodl.KeyAnyValue) [
-->             (vmodl.KeyAnyValue) {
-->                key = "reason",
-->                value = "Failed to add DV Port in vmkernel: Status (bad0006)= Limit exceeded"
-->             }
-->          ],
-->          message = "Operation failed, diagnostics report: Failed to add DV Port in vmkernel: Status (bad0006)= Limit exceeded"
-->       }
-->    ],
-->    text = ""
-->    msg = "An error occurred during host configuration."

Environment

7.x

Cause

The allocated memory for a large number of virtual distributed switch ports exceeds the dvsLargeHeap parameter (DVSLargeHeapMaxSize)

Resolution

The DVSLargeHeapMaxSize default is 300 andcan be increased to a maximum of 2048.  

Increase the value of DVSLargeHeapMaxSize parameter on every affected ESXi host:

1. Verify the current configuration:   esxcli system settings advanced list -o /Net/DVSLargeHeapMaxSize
2. To update the setting:
   
   • Put the host in Maintenance Mode
   • Run the CLI command:  esxcli system settings advanced set -o /Net/DVSLargeHeapMaxSize --int-value 512
   • Reboot the ESXi Host
   • Take the host out of Maintenance Mode
3. In VIO, test launching instances to validate.