Script execution timeout due to pending virtual service in VMware Cloud Director Container Service Extension

Products

• VMware Cloud Director

Issue/Introduction

• When deploying a new cluster, it eventually fails to complete with a script execution timeout, similar to the following:
  
  Name:    ScriptExecutionTimeout
Type:    Error
Resource Name:    EPHEMERAL-TEMP-VM
Detailed Error:    [error while bootstrapping the machine [#####/EPHEMERAL-TEMP-VM]; timeout for post customization phase [guestinfo.cloudinit.kind.cluster.creation.status]] during cluster creation
  
  
• In the logs, an error similar to the following is found:
  
  Error: "#####-kubeconfig" not found in namespace "#####-ns": secrets "#####-kubeconfig" not found waiting for kubeconfig to be available ...
  
  
• When reviewing the bootstrap logs, the following can be seen:
  
  cluster infrastructure is not ready
  
  
• In the capvcd logs, the following error could be seen repeatedly up until the end of the attempt:
  
  Error getting load balancer. Virtual Service is still pending
  
  
• When reviewing the virtual service for the load balancer in the VMware Cloud Director (VCD) user interface, it is still in a Pending state.
• Upon review of the underlying AVI load balancer, the item is in an error state with an error message which could be similar to the following:
  
  maximum failed attempts to create service engine reached. valid vcenter not be found to create serviceengine

Environment

VMware Cloud Director Container Service Extension 4.2.x

Cause

VMware Cloud Director Container Service Extension (CSE) will wait until there is a valid virtual service for the AVI load balancer before continuing additional tasks in the deployment and configuration of the cluster. If the service does not deploy successfully before a timeout is incurred, CSE will discontinue the deployment and the attempt will fail.

Resolution

In order to successfully deploy clusters using CSE, correct any issues in the AVI load balancer configuration that prevent the deployment of new virtual services. Once completed, retry the cluster deployment.